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ABSTRACT 


This  project  reports  the  results  from  a  customer  satisfaction  survey  conducted  for  a  central 
Texas,  start-up  health  maintenance  organization  using  the  National  Committee  for  Quality 
Assurance’s  Annual  Member  Health  Care  Survey,  Version  1.0.  The  primary  criterion  was 
overall  customer  satisfaction;  however,  other  criteria  were  tested  in  conjunction  with  a 
hypothesis  that  postulated  differences  between  the  HMO’s  two  benefit  plan  options.  The 
potential  predictors  were  over  100  key  health  care  variables  including:  measures  of 
satisfaction  with  health  care  services,  plan  administration,  the  management  of  care,  and 
physician  con^etencies;  health  status  indicators;  behavioral  intentions;  line-of-business; 
and  basic  demographics.  The  Student’s  t-test  and  stepwise  multiple  linear  regression 
analyses  were  used  to  investigate  hypothesized  relationships  among  the  criteria  and 
predictors  (n  =  611).  The  Student’s  t-test  revealed  statistically  significant  results  for  the 
line-of-business  predicting  overall  customer  satisfection,  t(609)  =  -2.29,  p  =  .022,  as  well 
as  eleven  other  criteria.  The  stepwise  regression  model  for  HMO  overall  customer 
satisfaction  (n  =  303)  yielded  nine  predictors  resulting  in  =  .7355,  F(9,  293)  =  90.52, 
p<  .0000.  Likewise,  the  regression  model  for  the  preferred  provider  organization  (PPO) 
overall  customer  satisfaction  (n  =  308)  identified  five  predictors  resulting  in  =  .6539, 
F(5,  302)  =  114.14,  p<  .0000.  The  results  of  the  project  suggest  health  plan  executive 
leadership  and  managers  should  regularly  assess  their  organization’s  intact  on  customer 
satisfaction.  Additionally,  the  use  of  a  limited  number  of  predictive  variables  to  conduct 
more  fiequent  “pulse  checks”  can  produce  meaningful  customer  satisfaction  information 
that  can  be  used  for  a  variety  of  organizational  purposes. 
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GLOSSARY 


Central  Limit  Theorem.  Tlie  theorem  in  mathematical  statistics  that  the  sampling 
distribution  of  the  mean  approaches  a  normal  curve  as  N  gets  larger. 

Customer  Satisfaction.  Generically  refers  to  the  measurement  of  one  or  more  of  a  variety 
of  customer  opinions  including  ratings  of  service  quality,  future  behavioral 
intentions,  patient  self-assessment  of  outcome,  and  satisfection. 

Exciting  Quality  Attribute.  Quality  attributes  wdiich  are  very  welcome  but  not  thought  to 
be  necessary  before  experienced. 

Expected  Quality  Attribute.  Quahty  attributes  which  are  necessary  and  expected. 

Evidence  of  Coverage.  A  description  of  a  health  maintenance  organization’s  or  managed 
care  organization’s  benefits,  exclusions  and  copayment/coinsurance  fee  structure. 

Line  of  Business.  A  set  of  products  and/or  services  that  are  related  to  each  other  by  such 
factors  as  the  target  customer,  the  mechanisms  through  which  they  are  marketed 
and  financed,  the  level  of  risk  accepted  and/or  even  their  price  range  (e.g.,  health 
maintenance  organization,  preferred  provider  organization.  Medicare-risk  contract. 
Medicaid-risk  contract) 

Managed  Care  Organization.  An  organization  that  offers  one  or  more  products  that 

integrate  financing  and  management  with  delivery  of  health  services  to  an  enrolled 
population;  are  responsible  for  delivering  services  (using  their  health  service 
organizations  or  through  contractual  arrangements)  and  (as  a  network  or  as 
individual  providers)  either  share  financial  risk  and/or  have  some  incentive  to 
deliver  efficient  services;  and  use  an  information  system  capable  of  monitoring  and 
evaluating  patterns  of  utilization  and  financial  outlays. 

Mixed-Model  Health  Maintenance  Organization.  A  health  maintenance  organization  that 
uses  one  or  more  provider  network  types  to  deliver  health  care  services  to  an 
enrolled  population. 

National  Committee  for  Quality  Assurance  (NCQA).  A  nonprofit  organization  committed 
to  the  development  of  health  care  quahty  standards  and  the  accreditation  of 
managed  care  organizations  based  on  these  standards. 


Rating  Scale  Anchor.  The  two  most  extreme  points  on  an  evaluation  scale  (e.g.,  on  a 
five-point  Likert  scale  one  [1]  and  five  [5]  would  be  the  anchors). 

Report  Card.  A  published  summary  of  health  plan  performance  which  generally  includes 
measures  of. 

Self-funded.  A  method  of  health  care  financing  in  which  the  en^loyer  group  accepts  and 
imderwrites  its  own  risk  and  is  primarily  responsible  for  fimding  the  claims 
payment. 

“Take  It  For  Granted”  Quality  Attribute.  Quahty  attributes  which  a  hospital  must  posses 
to  be  acceptable. 


XI 


CHAPTER  ONE 


INTRODUCTION 

While  other  service  industries  have  been  measuring  and  leveraging  customer 
satisfaction  for  years,  managed  care  organizations  (MCOs)  are  relatively  new  participants 
in  using  customer  satisfaction  measures  for  other  than  traditional  quality  assurance 
programs.  However,  this  paradigm  is  rapidly  changing  as  the  delivery  and  financing  of 
care  have  become  more  integrated,  and  MCOs  have  become  the  primary  organizations  for 
arranging  and/or  providing  care  across  the  health  care  continuum  As  the  health  care 
market  continues  its  march  toward  the  fiirther  integration  of  financing  and  delivery  (i.e., 
capitation  and  full-risk  products),  MCOs  must  be  able  to  meet  and  exceed  the  demands  of 
numerous  customers  and  suppliers  in  the  health  care  value  chain.  Now  recognized  as  an 
inq)ortant  and  viable  outcome  measure,  the  ability  to  measure  customer  satisfaction  and 
use  it  for  strategic  planning  and  marketing  purposes  are  rapidly  becoming  the  norm  for 
MCOs  strivmg  to  itrq)rove  their  services  and  market  share.  This  graduate  management 
project  will  examine  the  concept  of  customer  satisfaction  in  detail  and  report  on  one  health 
maintenance  organization’s  experience  using  a  standardized  customer  satisfaction  survey 
in  two  distinct  lines  of  business. 
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Problem  Question 


Quality  improvement  programs  include  structure,  process  and  outcome  measures. 
Of  the  three,  outcomes  are  considered  critical  to  the  fixture  of  MCOs,  particularty  those 
that  seek  accreditation.  A  MCO’s  ability  to  measure,  report  and  use  one  crucial  category 
of  outcome  measures,  customer  satisfaction  measures,  will  play  an  essential  role  in 
building  customer  loyalty  and  market  share.  What  are  the  key  predictors  that  MCOs  must 
influence  to  substantially  affect  customer  satisfaction  among  their  different  lines  of 
business? 


Conditions  Which  Prompted  the  Study 

The  Dau^ters  of  Charity  National  Health  Services  (DCNHS)  is  a  chain  of  40 
hospitals  nationwide  that  offers  inpatient,  outpatient,  and  ancillary  services  to  its  clients. 
The  Daughters  of  Charity  Health  Services  of  Austin  (DCHSA),  the  Austin  market's 
subsidiary  of  the  DCNHS,  is  cxirrently  doing  business  as  the  SETON  network.  The 
SETON  network  has  been  a  leader  of  managed  care  for  both  the  DCNHS  and  the  Austin 
area  through  their  introduction  of  numerous  MCOs  such  as  a  physician  hospital 
organization  (Seton  Physician  Hospital  Network),  a  risk-assuming  capitated  physician 
group  (Advantage  HealthCo),  and  a  physician  management  services  organization 
(Advantage  Management  Services  Organization).  In  September  of  1995,  the  SETON 
network  added  a  new  MCO  when  they  ventured  into  Austin’s  health  maintenance 
organization  (HMO)  market  with  the  introduction  of  the  Seton  Health  Plan  (SHP), 
Incorporated.  Figure  1  depicts  the  organizational  relationships  between  the  SETON 
network  and  its  subsidiaries. 
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FIGURE  1 
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Physician/Group  Management 
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1 

&  Consulting  Services 

Seton  Health  Plan  Factors 

The  Seton  Health  Plan  is  a  start-up,  for-profit  HMO  incorporated  under  Texas 
Insurance  Code  20A,  Texas  Health  Maintenance  Organization  Regulations.  Because 
current  medical  practice  laws  in  Texas  forbid  HMOs  from  directly  en^loying  physicians, 
the  SHP  is  using  independent  practice  associations  (IPA),  group  and  network  providers 
for  health  care  services;  therefore,  SHP  is  a  mixed-model  HMO.  Furthermore,  SHP  is  a 
hospital-based  HMO  since  their  capital  partner  in  the  venture  is  the  SETON  network.  As 
required  by  the  Texas  Department  of  Insurance  (DOI),  the  SHP  filed  an  Evidence  of 
Coverage  (EOC)  and  Schedule  of  Benefits  v^fiich  describes  the  SHP  benefit  design  for 
their  fidly-insured  commercial  HMO  product.  Presently,  the  SHP  has  not  sold  a 
commercial  account  and  has  not  enrolled  any  fidly-insured  lives  under  their  state  filing. 
Instead,  SHP  is  currently  servicing  two  self-fimded  accounts  encotrq)assing  almost  1 1,000 
members.  One  of  the  accounts  is  the  city-organized  health  care  welfare  program  (Medical 
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Assistance  Program).  Members  of  this  account  were  excluded  from  the  study  because  of 
the  limited  involvement  the  SHP  has  in  providing  network  or  administrative  services.  The 
other  account  is  the  approximately  5,500  SETON  network  employees  and  their  eligible 
dependents.  For  this  self-funded  accoimt,  the  SHP  provides  network  and  administrative 
services  for  an  HMO  and  PPO  option.  These  two  options  and  their  associated  benefit 
designs  have  only  been  in  existence  since  July  1,  1995.  Prior  to  that  time,  SETON  offered 
their  employees  two  PPO  options:  high  plan  and  low  plan. 

During  the  initial  stages  of  strategic  planning,  SETON  network  leadership  and  the 
SHFs  Board  of  Directors  determined  that  the  new  HMO  needed  to  measure  customer 
satisfaction  to  satisfy  market  demands  and  organizational  goals  (see  Table  1).  Without 
customer  satisfaction  information,  the  leadership  of  both  organizations  believed  it  would 
be  difficult  to  secme  commercial  accounts,  to  be  accredited  by  the  National  Committee  for 
Quality  Assurance  (NCQA)  and  to  meet  consumer  demand  for  HMDs  to  provide  quality 
information  regarding  their  services.  Additionally,  SETON  network  leadership  e^^ected 
the  SHP  to  meet  corporate  guidelines  requiring  all  subsidiaries  to  measure  and  report 
customer  satisfaction  with  their  products  and  services.  Furthermore,  by  undertaking  the 
study,  the  HMO  would  be  able  to  establish  customer  satisfaction  as  an  organizational 
precedent  and  ongoing  concern  for  the  organization.  Lastly,  the  study  would  provide 
SETON  leadership  with  the  unique  opportunity  to  survey  its  own  etrq)loyees  satisfection 
with  their  health  care  services  and  to  potentially  use  the  results  to  improve  enq)loyee 
morale.  As  a  result.  Board  members  resolved  that  within  one  year  of  operations,  the 
HMO  would  have  a  survey  instrument  selected,  a  baseline  study  conducted  and  the 
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methods  and  procedures  institutionalized.  Additionally,  the  members  clearly  articulated 
their  belief  the  information  would  provide  a  fixture  conq)etitive  advantage  when  SHP 
sought  accreditation,  entered  new  markets,  and  started  other  lines  of  business. 


TABLE  1 


SETON  HEALTH  PLAN  FACTORS 

Austin 

Market 

En5)loyer  group  and  customer  expectations 

SETON 

Conadered  an  important  network-wide  quality  indicator 

Network  leadership  expects  subsidiaries  to  measure 
customer  satis&ction 

Opportunity  to  measure  their  own  employees’ 
satisfection  with  health  services 

SHP 

Required  for  accreditation  purposes 

Estabh^  customer  satisfaction  as  an  organizational 
precedent 

System  used  must  measure  satisfaction  across  multiple 
lines  of  buaness 

Military  Health  Service  System  Factors 

The  Department  of  Defense  (DoD)  is  currently  in  the  process  of  regionalizing  the 
Military  Health  Service  System  (MHSS)  into  twelve  distinct  regions  of  care.  This  effort, 
known  as  TRICARE,  is  based  upon  the  seamless  integration  of  two  delivery  systems 
which  were  previously  separated:  Military  Treatment  Facilities  (MTFs)  and  the  Civihan 
Healthcare  and  Medical  Programs  for  the  Uniformed  Services  (CHAMPUS).  Under  the 
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new  ^stem,  eligible  DoD  beneficiaries  will  be  able  to  choose  from  one  of  three  benefit 
designs  for  their  health  care  deUveiy:  (1)  HMO  with  Point-OfrService  (POS),  (2) 

Preferred  Provider  Organization  (PPO),  or  (3)  standard  indemnity.  Where  possible,  MTFs 
will  be  the  site  of  choice  for  delivering  health  care  to  enrolled  HMO  members.  For  out-of- 
MTF  needs  and  PPO  and  standard  indemnity  purposes,  each  region  has  bid  the  remainder 
of  the  health  care  delivery  to  a  managed  care  support  (MCS)  contractor  for  each  of  the 
twelve  regions.  DoD  executive  oversight  of  these  contracts  is  handled  by  a  “Lead  Agent” 
office  in  each  region.  In  this  new  environment,  the  Lead  Agent’s  ability  to  measure 
customer  satisfaction  both  in  and  outside  the  MTFs  will  be  extremely  iicportant  to 
assessing  the  effectiveness  of  each  TRICARE  MCS  contract.  The  mformation  can  also  be 
used  in  regional  quaUty  improvement  (QI)  programs.  Furthermore,  civihan  contractors 
will  need  to  inq)lement  and  measure  customer  satisfaction  to  earn  re- award  of  their 
contracts.  The  availability  of  a  tested  survey  instrument  and  process  may  provide  a 
valuable  tool  to  the  regional  contractors  and  the  MHSS.  Table  2  provides  a  summary  of 
the  MHSS  factors  that  prompted  the  selection  of  this  topic  for  the  study. 


TABLE 2 


MILITARY  HEALTH  SERVICE  SYSTEM  FACTORS 

ISS^SSI 

MHSS 

Method  of  assessment  for  MCS  contracts’ 
effectiveness 

Lead 

Results  of  survey  used  as  customer  satisfaction 

Agents 

template  system 

MCS 

Study  used  as  benchmark 
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Limitations 


Studies  of  this  nature  are  not  without  their  limitations,  especially  since  llie  SHP  is  a 
start-up  company  focused  on  establishing  its  business  practices  and  penetrating  its  target 
markets  (see  Table  3).  Of  these  limitations,  tiie  use  a  self-funded  population  has  the 
greatest  impact  on  SHP’s  capacity  to  apply  the  results  for  commercial  purposes  because  of 
a  lack  of  similar  benefit  designs  and  plan  administration  issues.  The  benefit  design  agreed 
upon  by  SETON  network  does  not  match  the  EOC  filed  with  the  state;  therefore,  the 
variables  measuring  satisfiiction  with  benefit  design  will  not  apply  to  commercial 
populations.  Additionally,  in  the  self-funded  environment,  certain  components  of  plan 
administration,  such  as  member  services,  claims  administration  and  customer  education 
materials,  are  not  being  administered  by  the  SHP.  Instead,  SETON  network  Human 
Resources  (HR)  and  outsourced  contractors  are  performing  these  functions.  Since  the 
study  is  retrospective,  variables  measuring  customer  satisfaction  with  plan  administration 
will  not  be  measuring  SHP’s  performance,  but  wiU  be  measuring  customer  satisfaction 
with  SETON  HR  and  outsourced  contractors.  Another  limitation  with  the  study  is  related 
to  the  limited  time  the  new  benefit  design  has  existed.  The  NCQA  protocol  stipulates  that 
enrollees  have  at  least  12  months  of  continuous  enrollment  in  the  health  plan  allowing  for 
multiple  breaks  so  long  as  no  one  break  exceeds  45  days  or  more.  Study  partic^ants  have 
had  only  seven  monfiis  of  continuous  enrollment,  \\hich  may  impact  the  actual  number  of 
respondents  that  have  had  the  opportunity  to  use  the  plan  benefits.  In  addition  to  these 
concerns,  the  NCQA  will  not  recognize  this  study  as  part  of  their  survey  process  until  it  is 
carried  out  by  a  third  party  research  company  and  survey  protocol  is  duphcated  exactly  as 
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outlined  in  the  manual.  As  a  result  of  these  factors,  the  generalizability  of  the  study  will  be 
limited  to  the  study  population  and  other  similar  populations. 


TABLES 


STIID^  LIMITATIONS 

■  'frnm 

NCQA 

Lack  of  formal  recognition  by  NCQA 

SETON 

SETON  network’s  health  care  programs  are  self-funded 

SHP 

Organizational  conpetition  fixr  future  resource  support 

Literature  Review 

The  current  focus  on  customer  satisfaction  measures  as  outcome  measures  is 
rooted  in  historical  quaUty  assurance  and  assessment  programs.  Understanding  the 
historical  and  chronological  evolution  of  quality  measures  clearly  sets  the  precedent  that 
outcome  measures,  particularly  diose  that  relate  to  customer  satisfaction,  will  be  the 
predominant  quality  measures  of  the  fixture.  To  estabUsh  a  framework  for  the  study  and 
its  resultant  conceptual  theory,  the  body  of  literature  related  to  the  quality  paradigm;  the 
chronological  development  of  outcome  measures;  the  establishment  of  customer 
satisfiiction  measures  and  standardized  surveys;  and  the  methodological  issues  and  utihty 
for  the  findings  must  be  examined. 


The  Quahty  Paradigm 

Outcome  measures  have  traditionally  been  part  of  the  triad  of  quality  assessment: 
structure,  process  and  outcome.  This  triad  has  been  the  foxmdation  for  examining  all 


8 


aspects  of  care  rendered  in  health  care  facihties  and  organizations  (Lohr  1988,  37). 
Structure  measures  focus  on  the  setting  and  environmental  issues  that  facihtate  the 
delivery  of  care.  For  exanq)le,  a  facility’s  licensure,  con^Uance  with  safety  codes  and 
number  of  board  certified  physicians  are  structure  measures.  Process  measures  focus  on 
the  manner  in  which  care  is  provided  and  include  such  measures  as  the  patient’s 
involvement  in  acquiring  care  and  the  physician-patient  interaction  (Williams  and  Torrens 
1993,  388-9).  Outcome  measures  focus  on  the  health  status  achieved  as  a  result  of 
medical  intervention.  MortaUty  rates  and  postsurgical  morbidity  rates  are  exanq)les  of 
outcome  measures.  Structure,  process  and  outcome  measures  are  intunately  woven 
together,  whereas  outcome  measures  are  built  upon  process  measures,  and  process 
measures  are  built  upon  structure  measures.  As  such,  the  three  dimensions  are 
interdependent,  and  all  need  to  be  measured  to  portray  an  acciuate  picture  of  the  quahty 
of  medical  care  being  delivered  in  health  care  organizations. 

The  Conceptual  Theory  of  Outcome  Measures 

As  previously  mentioned,  outcome  measures  fall  into  the  “Outcome”  category  of 
the  quahty  assessment  triad.  The  outcome  category  has  been  defined  by  numerous  authors 
in  the  health  care  hterature.  Avedis  Donabedian,  one  of  the  undisputed  leaders  in  health 
care  quality  theory  and  implementation,  offers  the  fohowing  definition: 

. . .  the  effects  of  care  on  the  health  status  of  patients  and  populations. 
Inq)rovements  in  the  patient’s  knowledge  and  sahitaiy  changes  in  the  patient’s 
behavior  are  included  under  the  broad  definition  of  health  status,  and  so  is  the 
degree  of  the  patient’s  satisfaction  with  care  (Donabedian  1988,  1745). 
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Another  proponent  of  outcomes  research,  Dr.  Paul  EUwood  (Hale  and  Weiner  1994,  34), 
also  believes  the  definition  of  outcome  includes,  “tracking  patients  with  a  single  condition 
over  a  period  of  time  and  reaching  conclusions  about  the  inq)act  medical  care  is  going  to 
have  on  them,”  Although  both  definitions  are  abstract,  they  focus  attention  on  the  feet 
that  outcomes  involve  individuals  and  poptilations,  in^rovement  in  behavior  and 
knowledge  and  most  importantly  patient  (or  customer)  satisfection. 

The  design  of  meaningful  outcome  measures  is  con^lex  and  exacting  work 
because  it  requires  one  to  look  across  the  continuum  of  care  and  carefully  analyze  all  the 
different  factors  that  may  influence  an  individual’s  or  population’s  health  status  or 
satisfaction.  The  dimension  of  health  (physiological,  physical  or  emotional),  timing  of  care 
and  an  established  relationship  to  a  process  of  care  are  all  characteristics  of  outcome 
measures  (Lohr  1988,  38).  Additionally,  Donebedian  beheves  that  these  characteristics  of 
outcomes  must  be  modified  by  adjustments  for  case-mix,  age  and  other  confomding 
factors  to  better  standardize  outcomes  information  between  delivery  settings  and  patient 
environments  (Donabedian  1992,  359).  These  characteristics  shape  the  development  of 
each  outcome  measure  and  provide  the  basis  for  being  able  to  measure  an  inq)rovement  in 
health  status  or  satisfection. 

Once  an  outcome  can  be  described,  it  can  be  measured.  When  determining  how  to 
measure  an  outcome,  researchers  and  clinicians  need  to  define  the  purpose  of  the 
measurement  and  identify  the  source  of  information,  the  data  collection  methodology  and 
the  agent  responsible  for  analysis  and  interpretation  of  the  data.  Furthermore,  the 
measurements  chosen  to  represent  an  outcome  must  have  the  properties  of  reliability  and 
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validity  present  to  make  them  meaning&l  and  generalizable  across  a  given  population 
(Lohr  1988,  37). 


The  Development  of  Outcome  Measures 
The  Chronological  Origins  of  Outcome  Measures 
1.)  The  Age  of  Development 

The  development  of  outcome  measures  is  not  a  new  science.  As  early  as  1916  the 
rudiments  of  outcome  measures  had  been  established  by  Ernest  Amory  Codman 
(Donabedian  1985,  244)  in  studies  he  termed  “end  results."  Codman  accmately 
ascertained  that  an  individuars  or  population’s  health  status  was  the  product  of  clinical, 
organizational,  administrative  and  economic  factors  which  could  be  measured  and  tested 
for  their  appropriateness.  Using  Codman’s  revolutionary  work,  others  began  examining 
the  relationship  between  health  outcomes,  and  healdi  status  and  health  care  delivery.  In 
1933,  Hooker  began  using  preventable  maternal  mortality  as  a  measure  of  quality  at  the 
New  York  Academy  of  Medicine.  In  1955,  Kohl,  also  at  the  New  York  Academy  of 
Medicine,  sponsored  an  outcome  study  on  improving  the  rate  of  preventable  perinatal 
deaths.  During  the  late  1950’s  and  early  1960’s,  the  use  of  mortality  rates  grew  in 
popularity  due  to  the  work  of  researchers  such  as  Shapiro  et  al.  of  the  Health  Insurance 
Plan  of  Greater  New  York,  and  Lipworth  et  al.  in  Britain.  These  researchers  outlined  the 
use  of  mortality  rates  as  outcome  measures  of  quality.  By  1964,  the  fundamentals  of 
measuring  outcomes  and  their  use  as  quality  indicators  were  firmly  established 
(Donabedian  1985,  245). 
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2.)  The  Age  of  Refinement 

Beginning  in  the  late  1960’s,  health  care  researchers  and  providers  began  refining 
outcome  measures  by  narrowing  the  use  of  outcomes  to  two  separate  categories 
(Donabedian  1985, 254-5).  Researchers  classified  the  first  category  of  outcome  measures 
as  a  Judgment  of  quality  in  and  of  themselves,  and  the  second  as,  outcome  measures  that 
were  a  "trigger  to  the  assessment  of  antecedent  process.  ”  Researchers  examining  the  use 
of  outcomes  as  a  judgment  of  quality  quickly  realized  that  adjustments  were  necessary  to 
account  for  a  multitude  of  confounding  fectors  that  would  hinder  the  generalizabUity  of 
outcome  measures.  Studies  conducted  by  Roemer  et  ak  led  to  adjustments  for  length  of 
stay  and  hospital  occupancy.  la  1969,  Bunker  et  al.  conducted  further  studies  in  outcome 
adjustments  in  the  National  Halothane  study  in  which  they  introduced  the  concept  of  case- 
mix  adjustment.  Researchers  at  the  Staff  of  the  Stanford  Center  for  Health  Care  Research 
proposed  the  most  radical  set  of  outcome  refinements  in  1976  when  they  outlined  risk 
adjustments  between  institutions  based  on  postsurgical  fatalities  (Donabedian  1985,  255). 
The  age  of  using  outcome  measures  as  judgment  criteria  for  quality  had  dawned. 

In  contrast,  studies  conducted  throughout  the  1970’s  by  John  Williamson  of  Johns 
Hopkins  University  focused  more  on  outcome  measures  as  “triggers  to  antecedent  health 
care.  ”  In  such  a  capacity,  adverse  outcomes  were  singly  an  identifier  that  an  underlying 
problem  may  exist  with  the  care  being  rendered  to  an  individual.  Moreover,  these  studies 
provided  the  foundation  for  the  development  of  practice  guidelines,  the  recognition  that 
other  measures  besides  morbidity  and  mortality  data  could  be  used  for  outcomes,  and  the 
recognition  that  standardized  functional  scales  were  also  important  to  outcome  measures. 
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Worldiig  from  this  premise,  and  using  the  Williamson  studies  as  a  foundation,  Mushline 
and  Appel  of  John  Hopkins  University  developed  one  of  the  first  health  status  indices 
known  as  the  “Problem  Status  Index”  (Donabedian  1985, 257).  The  use  of  health  status 
indices  fiirthered  the  field  of  outcome  measures  by  recognizing  that,  not  only  were  clinical 
and  fimctional  status  in5)ortant  measures,  but  the  patient ’s  perception  of  his  or  her  well¬ 
being  also  contributed  to  the  in:q)rovement  of  health  status  and  could  be  measured  (Lohr 
1988,  38).  These  original  studies  shaped  the  development  of  today’s  most  common  health 
outcome  measures,  “the  five  D’s:”  death,  disease,  disability,  discomfort  and 
dissatisfrction. 

3.)  The  Age  of  Criticality 

Until  more  meaningful  measures  are  developed,  the  “five  D’s”  are  still  the  most 
commonly  used  outcome  measures  for  assessing  an  individual’s  or  population  s  health 
status  and/or  the  value  of  care  received.  As  an  exanqile,  >\fren  the  Health  Care  Financing 
Administration  (HCFA)  decided  to  release  hospital-specific  mortality  rates  as  a  baas  for 
corqiarison,  the  hospital  sector  vocally  opposed  the  decision  (Bergman  1994,  36).  Health 
care  providers  and  organizations  have  also  raised  concerns  with  the  disease,  disability  and 
discomfort  measures.  First  and  foremost,  providers  are  concerned  with  the  almost 
exclusive  use  of  physiologic  variables  as  the  outcome  measures  for  disease.  Although 
many  measures  are  both  reliable  and  valid,  they  often  require  practitioners  to  glean  large 
amounts  of  information  from  the  patient  directly  and  to  subject  the  patient  to  invasive 
testing.  Furthermore,  if  the  patient’s  medical  condition  resolves,  and  she  does  not  return 
for  follow-up  care,  the  health  care  provider  and/or  organization  may  never  adequately 
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capture  the  positive  intact  treatment  had  on  her.  Health  care  providers  and  organizations 
are  equally  concerned  with  the  disability  outcome  measures.  Current  measures  such  as 
days  of  disability  are  valuable  in  the  fact  that  they  measure  the  progress  of  health  care 
delivery  as  a  whole,  but  may  M  to  reflect  the  quality  of  care  rendered  to  an  individual  A 
prime  exanq)le  is  when  a  provider  recommends  a  given  number  of  days  in  bed  as  an 
appropriate  therapy  for  a  given  condition.  If  the  outcome  being  measured  for  that 
condition  is  disability  days,  the  health  care  organization  and  its  providers  might 
inadvertently  demonstrate  an  unfiivorable  outcome,  when  in  feet,  appropriate  protocols 
and  standards  of  care  are  being  followed.  Present  discomfort  outcome  measures  also 
present  some  unique  problems  which  health  care  organizations  and  providers  must 
overcome  to  improve  the  delivery  of  health  care.  Of  all  measures,  providers  place  the 
least  enq)hasis  on  quantifying  discomfort  over  time  because  it  is  difficult  to  accompli^  and 
usually  requires  the  use  of  a  health  status  questionnaire.  This  is  not  to  say  that  providers 
and  health  care  organizations  are  ignoring  the  needs  of  those  in  discomfort.  Instead,  they 
realize  the  difficulty  of  gathering  data  from  self-reported  health  status  questionnaires 
(Lohr  1988,  39). 

These  concerns  are  fiirther  exacerbated  by  the  data  collection  process  and  lag  time 
for  receiving  data.  At  present,  most  outcome  studies  are  retrospective  and  use 
administrative  claims  data.  These  data  usually  lag  12  to  18  months  behind  the  actual 
service  date  and  may  be  coded  incorrectly  by  the  provider  or  coding  ^ecialist.  As  such, 
the  lack  of  real  time  data  for  intervention  purposes  is  somewiiat  limited.  This,  however, 
does  not  mean  retrospective  data  is  without  value.  On  the  contrary,  retrospective  data  is 
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valuable  in  assessing  long  term  performance  and  ^ould  be  used  to  address  changes  in  the 
total  health  care  delivery  ^stem  (Leatherman  et  aL  199 1,351).  These  concerns  have  been 
addressed  by  ciurent  research  that  is  mainly  geared  toward  the  development  of  outcome 
measures  as  effective  and  efficient  indicators  of  the  value  of  the  health  care  service 
delivered  (Lohr  1988,  39-43).  The  landmark  health  outcomes  studies  discussed  in  detail 
later  have  attempted  to  assess  and  estabU^  the  reliability  and  validity  of  u^g  outcome 
measures  (including  customer  satisfection)  as  determinants  of  health  care  quality  and 
value,  and  to  set  a  framework  for  outcome  measures  in  the  fiiture. 

4.)  The  Age  to  Come 

Regardless  of  the  promising  results  of  current  outcomes  research,  MCOs  free 
three  challenges  in  the  future  which  require  further  investigation:  (1)  demonstrating  the 
linkage  between  process  and  outcome,  (2)  establishing  criteria  that  are  vooxq  flexible  and 
adaptable  to  the  clinical  peculiarities  of  each  case,  and  (3)  making  advances  in  health 
status  assessment  tools  (Donabedian  1988, 1748  and  Lohr  1988, 44-7).  If  the  users  of 
outcome  data  cannot  clearly  link  the  processes  of  the  care  delivered  to  fevorable 
outcomes,  it  will  be  highfy  unlikely  that  outcome  measures  will  e?qpand  beyond  their 
current  appheations.  however,  strong  linkages  can  be  establi^ed,  outcome  measures 
will  provide  substantial  and  pertinent  data  on  how  to  in^rove  the  quality  and  value  of  the 
care  delivered. 

A  corollary  to  improving  the  linkage  between  process  and  outcome  will  be  creating 
criteria  and  standards  that  are  more  flexible  and  adaptable.  The  new  criteria  will  need  to 
focus  on  the  continuum  of  care  and  enable  MCOs  to  predict  outcomes  for  a  given 
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condition  and  population  (Donabedian  1988,  1748).  Additionally,  the  criteria  will  need  to 
be  flexible  enough  to  cover  the  spectrum  of  delivery  systems  and  sites  of  care. 

Lastfy,  the  users  of  outcome  measures  in  the  future  will  need  to  make  advances  in 
developing  health  status  assessment  tools.  Lidividuals  and  organizations,  including 
MCOs,  will  need  to  improve  and  eiqiand  the  current  pool  of  health  status  indices  because 
they  are  currently  centered  on  adults  and  the  nonelderly.  MCOs  will  also  need  to  establish 
incentives  for  olioicians  to  use  these  tools  in  then:  practices  as  a  method  of  assessing  the 
impant  a  clinician’s  practice  has  on  health  and  fimctional  status  (Lohr  1988,  46-7). 
Uhimately,  developers  of  outcome  measures  will  be  ta^ed  to  strengthen  the  correlation 
between  the  health  status  assessment’s  outcome  measure  and  their  commensurate 
physiologic  interventions  diereby  making  nonintrusive  data  more  accurate  (Lohr  1988, 
46). 

T.atidmark  Outcome  Studies 

The  work  done  by  the  early  pioneers  such  as  Codman,  Roemer  and  Bunker, 
estabhshed  the  foundations  for  using  outcomes  as  a  measure  of  health  quality;  however, 
more  recent  studies  have  focused  on  inqiroving  the  measures  themselves.  The  primary 
contribution  of  these  studies  has  been  to  establirii  the  reliability  and  validity  of  using 
outcome  measures  as  determinants  of  health  care  quality  and  value.  Within  the  battery  of 
outcome  measures  used  in  each  study,  measures  ^ecifically  related  to  customer 
satis&ction  were  also  estabhshed  as  rehable  and  vahd.  As  a  result,  the  customer 
satisfaction  measures  used  in  these  surveys  firmly  iucorporated  the  practice  of  using 
customer  satis&ction  measures  for  assessing  health  care  quality  and  value. 
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1.)  RAND  Health  Insurance  Experiment  (HIE) 

One  of  the  original  studies  substantiating  health  outcomes  as  reliable  and  vahd 
indicators  of  quality  is  the  RAND  HIE.  This  study  (Wagner  and  Bledsoe  1990, 191)  is 
particularly  important  to  MCOs  as  it  represents,  . .  the  most  persuasive  evidence  to  date 
regarding  the  consequaices  of  various  health  insurance  plans  on  health  care  costs, 

cUent  satisfection  and  health  status.”  Conducted  betvkreen  November  1974  and 
January  1982,  the  HIE  was  a  large-scale  controlled  trial  that  san^led  2,800  femihes 
(7,700  persons)  located  in  six  areas  of  the  United  States,  vriio  were  randomly  asrigned  to 
several  different  health  insurance  plans.  The  plans  ranged  from  an  HMD  option  to  fee-for- 
service  (FFS)  options  with  coinsurances  ranging  from  0  to  95  percent.  The  Group  Health 
Cooperative  of  Puget  Sound  (GHC),  a  staff  model  HMO,  was  the  only  participating 
MCO,  although  it  could  be  argued  that  some  FFS  options  largely  mimic  the  preferred 
provider  organizations  (PPO)  and  point-of-service  (POS)  plans  widefy  available  today. 
Researchers  collected  data  from  a  variety  of  sources  including:  a  detailed  annual 
questionnaire,  phyrical  examinations,  and  health  status  questionnaires.  The  health  status 
measures  alone  included  over  26  indicators  for  physical  health,  mental  health,  role 
functioning,  social  functioning,  health  perceptions,  lifestyle  and  serious  symptoms. 
Outcome  measures  regarding  customer  satisfaction  were  also  collected.  These  measures 
(health  status,  outcomes  based  on  satisfrction,  other  health  outcome  measures  and  a 
variety  of  clinical  and  laboratory  findings)  were  then  used  in  a  nationwide  study  to  assess 
the  improveTnent  s  or  the  degradation  of  the  health  status  of  the  individuals  assigned  to 
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each  type  of  health  insurance  plan.  From  the  data  collected,  many  different  researchers 
conducted  a  variety  of  analyses. 

One  of  the  most  compelling  analyses  was  done  by  Ware  et  aL  (1987).  U^g  13  of 
the  26  health  status  measures  and  a  battery  of  other  health  outcome  measures,  Ware  et  al. 
discussed  three  major  points:  (1)  medical  expenditures  at  GHC  were  25  percent  less  than 
the  two  FFS  plans  particq)ating  in  the  study,  (2)  HMO  care  was  associated  with  lower 
overall  general  chent  satisfection,  and  (3)  sgnificant  health  status  differences  existed 
between  high  and  low  income  individuals  t^ho  started  the  study  with  existing  health 
problems.  From  his  findings.  Ware  and  his  team  concluded  that  HMO  care  for  the 
economically  sound  could  produce  cost  savings  without  sacrifices  to  a  member  s  health 
status.  However,  the  researchers  also  concluded  that  sicker  and  poorer  HMO  members 
may  be  adversely  affected  health  status  con^^ared  to  their  FFS  counterparts. 

Another  analysis  of  the  RAND  HBE  data  was  conducted  by  Sloss  et  al.  (1987,  130- 
6).  In  this  study,  Sloss  con5)ared  the  resuhs  of  HMO  and  FFS  members  for  all  26  of  the 
health  status  measures  and  additional  measures  firom  clinical  and  laboratory  findings. 

Their  findings  clearly  contradicted  those  of  the  Ware  et  al.  study.  Sloss’s  group  found 
that  no  differences  in  the  26  health  status  indicators  existed  between  HMO  and  FFS  plan 
members.  Additionally,  the  Sloss  team  found  no  agnificant  differences  between  high  and 
low  income  members  of  the  HMO  group  for  any  of  the  other  outcome  measures. 

Concerned  with  the  findings  and  conclusions  the  Ware  group  had  suggested.  Dr. 
Edward  Wagner,  one  of  the  GHC’s  practicing  physicians,  provided  commentary  in  Ihe 
Tniimal  nf  the,  American  Medical  Association.  Although  he  agreed  with  the  utilization. 
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cost  and  satisfection  findings  of  both  studies,  he  did  not  agree  with  the  conclusions 
reached  for  low-income,  sicker  HMO  members.  Wagner  argued  that  for  the  health  status 
measures  analyzed  in  both  the  Ware  and  Sloss  studies,  only  two  reached  statistical 
significance  and  they  were  characterized  by  small  san^le  sizes,  large  baseline  differences 
and  large  standard  deviations  (Wagner  and  Bledsoe  1990, 200). 

Although  the  RAND  HTF  reports  and  subsequent  analyses  provided  insightfiil  and 
provocative  theories  about  the  differences  in  health  status  and  patient  satisfection  between 
HMO  and  FFS  participants,  an  even  greater  contribution  was  made  to  the  field  of  outcome 
measures.  The  greatest  contribution  the  RAND  HIE  study  made  was  that  a  variety  of 
clinical  and  self-reported  health  outcomes  were  used  to  readily  assess  changes  in  health 
status  over  time  (Wagner  and  Bledsoe  1990, 200).  As  such,  the  RAND  HIE  opened  the 
door”  for  the  use  of  outcome  measures,  including  client  satisfection,  as  viable  measures  of 
quality  and  value. 

2.)  Medical  Outcomes  Study 

The  Medical  Outcomes  Study  (MOS)  was  an  observational  study  conducted  to 
serve  two  purposes: 

(1)  rompare  the  variations  in  patient  outcomes  with  differences  in  physician 
specialty,  the  health  care  delivery  system,  the  intensity  of  resources 
e?q)ended  and  clinicians’  technical  and  interpersonal  style,  and  (2)  to 
develop  practical  tools  for  monitoring  patient  outcomes  and  their 
determinants  in  routine  practice  (Kravitz  et  aL  1992,  1617). 

The  MOS  sampled  both  phyacians  and  patients  in  different  ^sterns  of  care  in  Boston, 
Chicago,  and  Los  Angeles,  between  1986  and  1990.  The  final  sanq)le  included  362 
providers  (348  physicians  and  14  nurse  practitioners)  across  a  large  variety  of  delivery 
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systems  and  specialties,  and  20,158  patients.  Data  were  collected  \^*icll  described  the 
patients,  providers,  treatment  processes,  utilization  of  resources  and  health  outcomes 
iachiding  customer  satisfection  from  such  sources  as  clinician  reports,  patient  reports,  and 
independent  clinical  examinations.  U^g  the  term  “patient  mix,”  (defined  as  the  socio¬ 
demographic  characteristics,  disease  prevalence,  severity  of  illness  as  associated  with 
biomedical  parameters,  and  the  fimctional  and  well-being  status  of  an  individual)  Kravitz 
et  al.  (1992,  1617-23)  found  differences  in  the  patient  mix  according  to  both  the  ^stem  of 
care  and  the  physician  specialty.  In  regards  to  the  system  of  care,  prepaid  patients  had 
higher  scores  on  health  perception  and  physical  fiinctioning  scales,  were  less  likety  to  have 
a  chronic  illness,  and  were  most  likely  to  be  nonwhite  (all  p  <  .01).  Conversely,  fee-for- 
service  (FFS)  patients  were  generally  older,  more  likely  to  be  white,  had  chronic  diseases, 
and  had  lower  fimctional  status  and  well-being  scores. 

The  MOS  researchers  also  made  significant  discoveries  regarding  the  usefulness  of 
the  outcome  measures  collected.  First,  they  demonstrated  a  general  agreement  between 
the  information  provided  by  patients  on  their  overall  health  assessment  and  usual  life 
activities,  and  that  provided  by  the  physician  in  terms  of  disease  severity.  Second,  they 
established  the  validities  of  the  MOS  fimctional  status  and  disease  severity  scales.  This 
last  point  is  particularly  conceding  (Kravitz  et  al.  1992,  1619-21)  as  the  MOS  health 
survey  used  to  rate  fimctional  status  and  well-being  contained  only  20-items  ^ecially 
designed  to,  “. . .  construct  health  status  indicators  for  general  health  perceptions,  physical 
function,  role  function,  social  function,  bodily  pain  and  mental  health.”  Third,  the 
researchers  also  demonstrated  the  need  for  adjustments  in  the  patient  mix  for  a  given 


population.  Lastly,  the  MOS  research  team  diowed  that  clinical  outcome  measures, 
patient-reported  functional  status,  and  well-being  outcome  measures  should  be 
incorporated  into  any  system  intending  to  use  outcome  measures  as  a  quality  or  value 
indicator  (Kravitz  et  aL  1992, 1623). 

Another  relevant  report  on  the  MOS  by  Safran  et  aL  (1994,  1579-86)  examined 
the  differences  in  the  quality  of  primary  care  delivered  in  prepaid  and  FFS  health  care 
systems.  Safran’s  team  found  that  prepaid  health  systems  had  increased  financial  access 
and  improved  coordination  of  care  for  their  patients.  Unfortunatefy,  these  poative 
findings  were  countered  by  reduced  patient-physician  continuity  and  comprehensiveness  of 
care,  and  by  diminished  organizational  access  and  interpersonal  treatment  that  was  less 
than  satis&ctory  to  patients. 

3.)  Patient  Outcomes  Research  Teams  (PORTs) 

With  the  reliability  and  validity  of  health  outcomes  gaining  momentum,  the  Agency 
for  Health  Care  Policy  and  Research  (AHCPR)  chartered  the  Medical  Treatment 
Effectiveness  Program  (MEDTEP)  to  further  develop  meaningful  outcome  measures. 
Under  MEDTEP  guidance  (Maklan,  Greene  and  Cummings  1994,  JS14),  fourteen 
separate  Patient  Outcomes  Research  Teams  (PORTs)  were  established  to  “...break  with 
the  traditional  health  services  research  and  with  traditional  clinical  ‘eflScacy’  studies. . . 
MEDTEP  research  shifts  the  focus  of  health  research  from  the  issues  of  organization  and 
processes  to  the  outcomes  of  health  care.”  The  PORTs  originated  from  the  behef  that 
wide  variations  in  practice  patterns  were  occurring  across  the  United  States  that  might 
adversely  affect  the  quality  of  care  rendered  to  individual  patients.  Using  Medicare  data 


21 


and  the  medical  literature,  the  PORTs  set  out  to  pioneer  revolutionary  new  practice 
guidelines  and  their  ejq)ected  outcomes.  The  PORTs  measured  outcomes  based  on 
survival  rates,  morbidity,  conq)lications,  physical  functioning,  resource  use  (cost  and 
readmissions),  syn^tom  relief  overall  health  status,  role  functioning  and  customer 
satis&ction  with  the  patient-provider  interaction  (Malkan,  Greene  and  Cummings  1994,  JS 
15-6).  However,  these  measurements  were  directly  tied  to  the  effectiveness  of  a  treatment 
decision  through  meticulous  research  and  analysis.  The  results  of  the  PORTs  research 
have  been  widefy  accepted  and  are  already  steering  the  health  care  industry  toward  the 
widespread  use  of  health  status  and  outcome  measures  (Morrissey  1994,  36). 

These  landmark  studies  were  critical  steps  toward  the  acceptance  of  outcomes  as 
reliable  and  valid  measures  of  quality  and  value.  They  also  established  that  self-reported 
measures  coiild  be  used  to  assess  the  quality  of  care  being  provided  to  individuals  and 
populations.  Lastly,  as  detailed  later  in  the  report,  the  studies  firmly  incorporated 
customer  satisfection  measures  as  an  integral  part  of  the  outcome  measurement 
movement. 

Customer  Satisfaction  Measures  as  Outcome  Measures 

The  inq)ortance  of  outcome  measures  is  without  dispute,  but  it  is  also  in^ortant  to 
note  that  many  respected  health  care  researchers  have  made  it  clear  that  customer 
satisfaction  measures  will  be  the  premier  outcome  measures  of  the  future  for  MCOs.  hi 
addition  to  Donabedian’s  quote,  Lufl  (Dolinsky  and  Caputo  1990,  3 1)  has  stated  that 
consumer  satis&ction  is,  “perhaps  the  most  inqiortant  dimension  of  HMO  performance 
while  being  the  least  understood  of  all  HMO  research  measures.”  hi  mature  managed  care 
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markets,  Fincham  and  Wertheimer  (1986,  5)  postulate  that,  ‘mamtaining  patient 
satisfaction  with  care  is  crucial  for  HMOs.”  Ware  (Nelson  and  Niederberger  1990, 410) 
has  stated  that  patient  satisfection  is  a  determinant  of;  “the  choice  of  health  care  provider 
or  systems,  use  of  services,  complaints  and  ma^iractice  suits.”  Health  services  marketing 
guru  MacStravic  (1982,  7)  has  listed  customer  satisfaction  as  a  key  criteria  for  an  HMO’s 
success.  As  evidenced  by  such  strong,  expert  opinion,  the  ability  to  measure  and  report 
customer  satis&ction  measures  is  paramount  to  the  long-term  viability  of  MCOs. 

Through  the  work  of  many  health  care  researchers,  employee  health  care  benefits 
managers  and  others  in  the  health  care  industry,  a  list  of  “premier”  health  care  customer 
satis&ction  measures  can  be  gleaned  from  the  health  care  literature  (see  ^pendix  A). 
Although  much  of  the  early  research  and  literature  focuses  on  satisfaction  with  hospital 
care,  the  more  recent  literature  has  kept  pace  with  the  rapid  spread  of  managed  care  by 
focusing  on  satisfrction  with  MCOs.  This  has  resulted  in  a  fundamental  shift  bompaticnt 
satisfaction  measurement  to  customer  satia&ction  measurement,  a  necessary  change  for 
MCOs  attenpting  to  maintain  customer  loyalty  and  build  market  ^are. 

Based  on  the  literature  and  interviews  with  experts  in  the  field  (Villani  and 
Sanqianes  1996),  these  customer  satisfection  measures  are  considered  the  “premier” 
variables  that  MCOs  will  need  to  measure  and  use  to  ensure  long-term  viability:  (1) 
overall  customer  satisfaction,  (2)  satisfaction  with  access  to  care,  health  services,  plan 
administration  and  the  management  of  care,  (3)  satisfaction  with  the  physician ’s 
technical  and  interpersonal  competencies,  (4)  willingness  to  recommend  the  plan  to 
family  and  friends,  (5)  intention  to  switch  to  a  different  plan,  (6)  successful  complaint 
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resolution,  (7)  self-reported  perceptions  of  overall  health  status  and  disease,  and  (8) 
basic  demographics.  Current  studies  vary  on  the  predictive  capabilities  of  global,  one- 
question  overall  satisfaction  measures.  However,  the  combination  of  multiple  measures  of 
satisfaction  with  health  care  and  health  plan  attributes  and  services  combined  with  the 
general  satisfaction  measure  have  proven  to  have  moderately  predictive  capabilities 
(Allen  et  al  1994,  31;  Fincham  and  Wertheimer  1986,  7-8;  Miller  and  Luft  1994, 1516; 
Ware  et  al.  1987).  Satisfaction  measures  (variables)  regarding  the  customer’s  perceptions 
with  physician  technical  and  interpersonal  competencies  are  well-grounded  in  historical 
and  recent  studies,  hi  feet,  questions  regarding  the  physician  interaction  have 
demonstrated  moderate  predictive  capabilities  across  a  range  of  delivery  sites  (Dolinsky 
and  Caputo  1990,  34-5;  Fincham  and  Wertheimer  1986,  7-8;  Ho,  Stegall  and  Wan  1994, 
71-2;  Nelson  and  Niederberger  1990, 416-9).  The  measure  for  willingness  to  recommend 
the  plan  to  family  and friends  has  strong  foundations  in  the  research  done  by  Davies  and 
Ware  (1991)  to  deagn  the  Group  Health  Association  of  America’s  Customer  Satisfaction 
Survey.  One  recent  and  very  impressive  study  conducted  by  Weiss  and  Senf  (1990, 438- 
41)  demonstrated  that  measures  of  a  customer’s  intention  to  switch  plans  are  strong 
predictors  of  customer  satisfaction.  In  addition  to  these  measures,  a  key  study  by  Moses 
(1995, 45)  has  demonstrated  the  inq)ortance  of  satisfactory  resolution  of  customer- 
services  related  problems  as  a  predictor  of  customer  satisfection.  Very  recent 
developments  in  the  reliability  and  validity  oi  self-reported  perceptions  of general  health 
and  disease  have  made  the  addition  of  these  measures  into  the  satisfaction  battery  a  must 
for  MCOs  (Boles  and  Wan  1992, 204;  Hall,  Milbum  and  Epstein  1993,  90-91;  Ware  et  al. 
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1987;  Zapka  et  al  1995,  76-81).  Finally,  wWle  having  limited  predictive  capabilities,  basic 
demographics  are  a  necessary  conq)onent  for  population  descr^tion  and  market 
segmenting  (Dolinsky  and  Caputo  1990,  35-6;  Zapka  et  al.  1995,  76-81). 

Key  Standardized  Surveys 

Using  the  constructs  and  variables  that  had  been  developed  from  these  studies  and 
others,  researchers  began  to  produce  standardized  customer  satisfection  surveys  which 
could  be  used  by  MCOs  and  other  health  care  organizations  to  assess  customer 
satisfriction.  One  of  the  most  conq)rehen^e  studies  to  date  regarding  the  development 
and  use  of  standardized  customer  satisfaction  surveys  was  conducted  by  Gold  and 
Wooldridge  (1995,  155-73).  The  study  found  that  surveys  were  being  conducted  by  95 
percent  of  HMOs  and  55  percent  of  PPOs  for  quality  purposes  using  internally-developed 
or  industry  accepted  surveys  (e.g..  Patient  Satisfrction  Questionnaire  [PSQ]  or  the  Group 
Health  Association  of  America  [GHAA]  Consumer  Satisfection  Survey).  The  study 
resuhs  also  suggested  that  the  purchasers  of  care,  management  consuhants  and  survey 
research  firms  are  also  involved  in  the  survey  process.  Often,  these  researchers  use  the 
GHAA  survey  and  the  Enq)loyee  Health  Care  Value  Survey  (EHCVS)  as  the  foundations 
fi)r  their  survey  materials.  Additionally,  government-based  programs  such  as  Medicaid 
and  Medicare  have  mandated  the  collection  of  customer  satisfaction  information  via  such 
survey  instruments  as  the  Medicare  Current  Beneficiary  Survey  and  state-based  surveys 
for  Medicaid-risk  products.  Grold  and  Wooldridge  (1995,  168-73)  and  other  authors  have 
also  identified  a  new  and  emerging  standardized  survey  battery:  The  Survey  Design 
Project  developed  by  the  Agency  for  Health  Care  Policy  and  Research  (AHCPR). 
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Through  AHCPR’s  work,  adult  and  child  health  instruments,  and  draft  surveys  for  hospital 
care,  mental  health  services  and  health  plan  disenrolhnent  have  been  created.  It  is 
antic^ated  that  these  surveys  will  be  released  in  1996  for  use  in  the  field  (NCQA  1995,  2). 
Li  addition  to  identifying  the  surveys  currently  being  used  in  the  market.  Gold  and 
Wooldridge  (1995,  160-7)  found  marked  differences  in  survey  focus,  item  content,  and 
methodological  practices  and  issues.  Ultimately,  their  study  and  others  suggest  that  three 
basic  standardized  surveys  or  some  combination  therein  have  been  most  frequentfy  used  by 
MCOs  for  survey  purposes:  the  PSQ,  the  GHAA  survey,  and  the  EHCVS. 


Patient  Sati.sfaction  Questionnaire 

As  described  earlier,  studies  fi'om  pioneers  such  as  Hulka  and  Woolley  hej^ed 
Ware  to  e^and  the  list  of  health  care  constructs  MCOs  and  other  health  care 
organizations  should  measure.  Based  on  his  own  work  and  Hulka  et  al,  Ware  et  al. 
designed  the  Patient  Satisfiiction  Questionnaire  (PSQ)  in  1983  (Ho,  Stegall  and  Wan 
1994,  67).  Ware  and  his  fellow  researchers  designed  the  PSQ  tool  to  focus  on  the 
characteristics  of  physicians  and  medical  services  via  well-defined  study  variables.  The 
PSQ  has  multiple  variables  which  assess  the  technical  and  interpersonal  skills  of  providers, 
waiting  times  for  the  appointment  process,  waiting  times  in  offices  and  emergency  rooms, 
satisfaction  with  the  costs  of  care,  and  the  availability  of  variety  of  resources.  Even 
though  the  PSQ  continues  to  undergo  revisions  and  it  is  still  used  in  health  care  research 
to  assess  customer  satis&ction,  the  PSQ’s  greatest  application  has  been  to  form  the 
foundation  for  many  other  surveys  (Davies  and  Ware,  1991,  3).  Testing  of  the  PSQ  tool 
has  demonstrated  it  is  a  reliable  and  valid  instrument  (Ho,  Stegall  and  Wan  1994,  67). 


The  GHAA’s  Consumer  Satisfaction  Survey  and  User’s  Manual 

The  second  edition  of  the  GHAA  survey  was  released  in  May  1991  after 
alterations  based  on  information  received  during  testing  and  use  of  the  first  edition.  The 
current  GHAA  survey  is  a  63-item  instrument  that  is  broken  into  two  separate  batteries: 
the  satisfection  battery  (47-items)  and  the  additional  variables  battery  (16-items).  Within 
these  two  batteries,  a  variety  of  health  care  constructs  have  been  identified.  As  with  the 
EHCVS,  guidelines  on  survey  sanqiling,  administration  and  data  analysis  are  included  in 
tiie  user’s  manual  (Davies  and  Ware  1991, 1). 

The  47-item  satisfaction  battery  originates  from  the  PSQ  developed  by  Ware  in 
1983  and  input  from  GHAA’s  research  and  legal  departments,  relevant  literature,  reviews 
from  the  use  of  the  first  edition  and  continuing  work  by  Davies  and  Ware.  The  first 
section  of  the  satisfrction  battery  has  3 1  questions  that  center  on  the  customer  s 
satis&ction  with  health  care  services  and  providers.  Based  on  the  Form  HI  PSQ  and  using 
a  five-point  “excellent”  to  “poor”  evaluation  response  scale  (excellent,  very  good,  good, 
fair  and  poor),  this  section  (3 1-items)  measures  eight  constructs  of  care  ranging  from 
accessibility  and  availability  of  services  and  providers  to  technical  quality  of  care.  The 
second  section  of  the  satis&ction  battery  has  16  questions  that  focus  on  the  customer’s 
satisfrction  with  the  health  plan.  Interestingly,  this  section  ( 16-items)  was  conqiletely  new 
to  the  1991  edition  of  the  GHAA  survey,  and  had  been  gleaned  from  sample  herns 
submitted  by  participating  health  plans  or  were  written  new  for  the  most  recent  edition. 
The  constructs  measured  in  this  section  are  features  specific  to  the  health  plan  or  health 
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msurance  plan.  Table  4  sununarizes  the  satisfection  battery  section  of  the  GHAA  survey 
(Davies  and  Ware  1991, 3-8). 


TABLE 4 


GHAA  SI  RMA 

SATISFAC  TION  BATTED 

Access 

11 

Finances 

2 

Technical  (Quality 

3 

Comnunication 

3 

Choice  and  Continuity 

3 

Liteipersonal  Care 

5 

Services  Covered 

3 

Information 

3 

Paperwork 

3 

Costs  of  Care 

2 

General  Satisfrction 

4 

Overall  Care 

Time  Spent 

Outcomes 

Overall  Quality 

Overall  Plan 

Source:  paraphrased  from  the  GHAA  Consumer  Satisfaction 
Survey  and  User’s  Manual  (Davies  and  Ware  1991,  8) 


The  second  battery  for  the  GHAA  survey  is  called  the  additional  variables 
battery.  This  battery  ( 16-items)  contains  variables  that  measure  survey  respondent 
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demographics  (seven  items),  use  of  services  (three  items),  health  status  (one  item),  access 
to  care  (three  items)  and  intentions  regarding  plan  related  behaviors  (two  items).  From 
this  information,  users  are  able  to  assess  useful  population  information  and  focus  on 
impnitatit  determinants  of  customer  satis&ction  and  loyalty  to  the  plan  (Davies  and  Ware 
1991,9-11). 

Etqplovee  Health  Care  Value  Survey 

The  EHCVS  was  the  result  of  a  first-ever  effort  by  three  large  U.S.  Corporations 
(Xerox,  GTE  and  Digital)  to  form  a  health  care  customer  satis&ction  consortium  The 
main  goal  of  the  Consortium  was  to  develop  a  standardized  survey  instrument  and  process 
which  could  then  be  used  to  evaluate  the  32  different  health  plans  providing  services  to  the 
consortium  Ihdep^dent  research  firms  were  used  to  develop  the  survey  and  conduct 
analyses,  and  for  data  collection  purposes.  The  result  was  a  154-item  survey  \Nhich 
combined  elements  fi’om  the  second  edition  of  the  GHAA  survey,  the  MOS  36-Item 
Short-Form  Health  Survey  (SF-36)  and  the  Healthier  People,  Health  Risk  y^praisal; 
Version  4.0  by  E.B.  Hutchins  into  one  comprehensive  survey.  Guidelines  for  survey 
samplings  administration  and  data  analysis  were  also  reported  in  the  EHCVS  (Allen  et  al. 
1994,  26-28  and  41). 

The  survey  focused  on  two  main  categories:  plan  performance  and  health  burden. 
Constructs  for  the  plan  performance  conponent  included  satisfoction  measures  for  health 
care  delivery  ratings,  delivery  experience  reports,  plan  administration  ratings  and  ‘bottom- 
line”  performance  indicators.  To  couplement  this  ‘health  systems”  battery,  the  health 
burden  constructs  measured  demographic  characteristics,  health  status  ratings,  medical 
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condition  reports  and  heaWi  risk  behavior  reports  (Allen  et  al  1994, 29).  Together,  the 
variables  from  these  two  categories  conq)ose  the  survey. 


NCOA  Survey 

Despite  the  abundance  of  reliable  and  vahd  survey  instruments  aheady  in  use  by 
MCOs,  a  new  survey  tool  was  recently  released  by  the  NCQA  which  provides  more 
detailed  information  over  the  survey  instruments  discussed  earlier.  Released  in  1995,  the 
NCQA  Annual  Member  Health  Care  Survey  Manual,  Version  1.0  (NCQA  survey)  has 
taken  the  best  conqjonents  of  other  standardized  surveys  in  the  field,  and  coupled  them 
with  information  that  has  emerged  from  the  managed  care  industry  within  the  last  four 
years.  First,  conq>ared  to  the  GHAA  survey  which  was  primarily  developed  for  en:q)loyer 
use,  the  NCQA  survey  was  developed  with  MCOs  as  the  primary  users  of  the  survey. 
Second,  the  survey  focus  changed  from  a  heavy  en^hasis  on  provider-related  variables,  to 
a  more  balanced  eitq)hasis  between  provider  and  plan  variables.  Third,  the  NCQA  survey 
expands  the  health  status  variables  without  overburdening  the  respondents  taking  the 
survey.  Finally,  the  NCQA  survey  provides  a  broader  range  of  information  within 
relatively  the  same  survey  length  as  other  standardized  surveys. 

The  NCQA  survey  (see  Table  5)  has  four  major  sections;  (1)  screening,  (2) 
satisfaction  with  care  and  plan  services  and  features,  (3)  respondent’s  health  and  daily 
activities,  and  (4)  socio-demographic  information  (NCQA  1995, 1).  It  is  m5)ortant  to 
note  many  of  the  questions  in  the  NCQA  survey  are  conq)osed  of  sub-questions. 
Therefore,  although  the  survey  fists  a  particular  number  of  questions  per  section,  the 
question  may  be  conq>osed  of  mult^le  sub-parts.  The  five  screening  questions  assess 
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membersh^,  enrollmeait,  and  the  usage  ofin-and  out-of-network  provider/fecility  use. 
These  questions  originate  from  the  Agency  for  Heahh  Care  Policy  and  Research  (AHCPR) 
Survey  Deagn  Project  (1995)  discussed  earlier.  This  data  is  generally  used  for 
verification  purposes,  but  could  also  be  used  to  ride-adjustment  the  sanq)le.  The  twelve 
questions  assesdng  satisfaction  "with  care  and  plan  services  and  features  are  further 
differentiated  into  health  care  and  plan  (items  6  throu^  13)  and  further  information  on 
services  (kerns  14  through  17)  sections.  The  majority  of  these  survey  kerns  come  from 
the  GHAA  survey  (1991),  although  the  wording  and  rating  scales  have  been  refined  to 
improve  their  relevance  to  the  consumer  and  to  reduce  the  mukicoDinearky  between  scales 
(NCQA  1995,  Appendix  11-6).  The  health  and  daily  activities  section  has  a  combination 
often  single  and  muki-kem  questions.  The  RAND  HIE  and  MOS  studies  provide  the 
majority  of  background  on  kem  selection  for  this  section.  Moreover,  work  started  by 
Ware  et  aL  in  1995  to  develop  a  shorter  veraon  of  the  36-kem  Short  Form  Health  Survey 
(SF-36)  conq)oses  a  major  portion  of  this  section  of  the  survey  (NCQA  1995, 6).  In 
addkion  to  assessing  the  health  burden  of  given  populations  and  product  lines,  the  NCQA 
anticipates  this  section  will  also  be  used  for  risk-adjustment  purposes.  Lastly,  the  six-kem 
socio-demographic  section  measures  general  population  characteristics.  As  with  the 
screening  section,  the  sodo-demographic  survey  kerns  were  refined  from  questions  in  the 
AHCPR  instruments  (NCQA  1995,  6). 
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TABLES 


NC  QA  SI  R\  BATTER^ 

Screoiing 

5 

Satisfrction  with  Care  and  Services 

1)  Health  Care  and  Plan 

8 

2)  Further  Information  on  Services 

4 

Health  and  Daily  Activities 

10 

Sodo-demographic 

6 

Source:  paraphrased  from  the  NCQA  Member  Satisfection  Survey, 
Version  1.0,  “Background  on  Survey  Items” 

(NCQA  Survey  1995,  5-6) 


Literature  Pertaining  to  Survey  Sanq)]ing,  Administration 
and  Methods/Procedures 

The  NCQA  Survey  provides  detailed  instructions  on  sanq)ling  and  data  collection. 
However,  during  the  course  of  planning  and  in^lementing  the  survey  for  this  investigation 
at  SHP,  current  literature  and  corporately-mandated  physician  and  staff 
sensitivity/courtesy  measures  resulted  in  deviations  from  the  NCQA’s  sartq>ling  and  data 
collection  instructions.  As  a  result,  specific  literature  relating  to  and  used  for  the 
development  of  the  methods  and  procedures  for  the  study  is  discussed.  In  particular, 
survey  length  and  salience,  response  points  and  rating  scales  and  anchors,  and  mail  survey 
administration  were  uiq)ortant  issues  in^acting  the  study’s  methods  and  procedures. 


Survey  Length  and  Salience 

A  recent  study  by  Bean  and  Roskowski  (1995, 20-6)  provides  great  insight  into 
survey  length.  In  their  study,  the  researchers  demonstrated  that  longer  surveys  do  have 
lower  response  rates.  This  was  particularly  true  in  surveys  vsiiere  the  survey  salience  (the 
questionnaire’s  inq)ortance  as  viewed  by  the  survey  rec^ient)  was  high  and  the 
questionnaire  lengths  were  dramatically  different.  Paul  and  Bracken  (1995, 45-9),  survey 
development  consultants,  give  the  following  recommendations  regarding  survey  length:  no 
more  than  80  to  100  questions  (not  inchiding  demographics)  and  no  longer  than  30 
minutes  to  enmplete  Moreover,  their  consensus  is  that  survey  salience  is  paramount  to 
survey  success.  The  researchers  also  found  that  high  response  rates  (approximately  80%) 
are  not  essential  to  obtaining  unbiased  data.  Thus,  the  researchers  concluded  placing  more 
ftiuphasis  on  survey  length  and  salience  was  a  productive  method  of  enhancing  survey 
response  rates. 

This  literature  was  inq)ortant  in  determining  vdiether  or  not  to  add  additional 
questions  to  the  survey.  Ultimatefy,  questions  on  physician  and  staff  sensitivity  and 
courtesy  and  specific  health  behaviors  were  added  to  the  survey.  These  questions  were 
added  because  they  were  innportant  to  corporate  goals  for  the  SHP  and  for  SETON 
network  employees  and  did  not  substantially  change  the  time  needed  to  complete  the 
survey  (conq)lete  time  was  15  to  20  minutes). 
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Response  Points.  Rating  Scales  and  Anchors  and  Response  Bias 

An  abundance  of  survey  deagn  ej^eits  in  health  care  and  other  industries  have 
written  volumes  on  response-scale  points  and  rating  scale  anchors.  A  comparative  study 
conducted  by  Ross,  Steward  and  Sinacore  (1995,  392-406)  provides  one  of  the  most 
exhaustive  commentaries  on  the  subject  of  rating  (measurement)  scales.  In  their  study,  the 
researchers  examined  the  variability  in  satis&ction  responses  using  the  seven  different 
scales  sununarized  in  Table  6.  The  findings  fi'om  the  study  rated  the  “general 


TABLE 6 


SI  iMMARN 

OF  RATING  S(  ALE  EFI  EC  TIN  ENESS 

Global  Satisfaction 

100  millimeter  visual  scale ;  “X”  marked  on 

Good 

( Visual  Analogue) 

the  scale  (1-item) 

Multidimensional 

Five-point  evaluation  response  based  on 

Evaluation  of  Quality 

“poor”,  “fair”,  “good”,  “veiy  good”. 

Good 

(ModifiedPSQ) 

“excellent”  (29-items) 

General  Satisfaction 

Five-point  Likert  scale  (6-items) 

Poor 

Physician  Satisfaction 

Five-point  Likert  scale  (4-items) 

Poor 

Overall  Satisfaction 

Five-point  evaluation  response  based  on 

{ModifiedPSQ) 

“poor”,  “fair”,  “good”,  “very  good”. 

“excellent”  (2-items) 

Good 

Behavioral  Intention 

Four-point  evaluation  response  based  on 

{Bipolar  Scale) 

“definitely  yes”,  “probably  yes”,  “definitely 

Poor 

not”,  “probably  not”  (4-items) 

Wdlingness-to-Pay 

Respondents  asked  “yes”  or  “no”  if  they 

{Dollar  Value  Scale) 

would  pay  a  certain  dollar  value  for  die 

appointment  and  “^^hat  would  be  the  most 
they  would  pay”  (2-item) 

Fair 

Source:  paraphrased  from  Ross,  Steward  and  Sinacore  (1995, 392-406) 
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satisfection”,  the  “phyacian  satisfection”  and  the  “behavioral  intention”  scales  as  poor 
measurement  scales.  This  was  mainly  due  to  the  &ct  that  these  measures  demonstrated 
poor  resistance  to  acquiescence  bias  and  poor  reliability  among  high  acquiescence 
respondents.  The  “willingness-to-pay”  scale  was  rated  as  feir  due  to  its  resistance  to 
acquiescent  bias;  however,  it  has  limited  practical  application  in  statistical  anatysis.  The 
authors  go  on  to  identify  the  “global  satisfection,"  the  “multidimensional  evaluation  of 
quality”  and  the  “overall  satisfection”  scales  as  the  best  for  use  in  customer  satisfection 
surveys  because  of  their  re^ance  to  bias  and  excellent  reliability. 

A  different  study  conducted  by  Paul  and  Bracken  (1995,  45-9)  provided  iiiq)ortant 
information  on  response  points,  rating  anchor  scales  and  response  bias.  The  authors  stress 
the  inqjortance  of  matching  scale  response  points  and  rating  scales  anchors  to  the 
information  being  assessed.  Furthermore,  if  different  rating  scales  are  going  to  be  used, 
the  authors  advise  using  the  mmiTniiTn  amount  necessaiy  and  clustering  questions  with 
dmilar  content  within  the  same  scale.  Finally,  the  authors  suggest  the  survey  instrument 
be  tested  for  any  response  bias  prior  to  its  administration.  If  response  bias  exists,  Paul  and 
Bracken  recommend  including  negatively  and  positively  worded  questions  to  assess  survey 
bias.  Findings  from  the  study  are  summarized  in  Table  7. 

The  information  on  response  points,  rating  scales  and  bias  was  used  to  construct 
the  additional  items  added  to  the  survey.  For  the  phyacian  and  staff  sensitivity  and 
courtesy  questions,  the  PSQ  evaluation  response  (poor,  feir,  good,  very  good,  and 
excellent)  was  used.  Additionally,  the  questions  had  been  tested  on  hospital  surveys  and 
did  not  demonstrate  response  bias.  Health  behavior  questions  added  to  the  survey  were 
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mainly  assessed  by  dichotomous  and  frequency-related  variables;  therefore,  response 
points  and  bias  were  eliminated. 


TABLE? 


SI MMAR^  OF  RESPONSE  POINT,  RATING  SC  ALE 

ANC  HORS  AND  RESPONSE  BIAS  THEMES 

Response 

Points 

Are  dependoit  on  the  information  required 

Use  odd  number  of  points  with  meaningful 
but  neutral  midpoint 

Include  more  response  points  to  refine  the 
data  collected 

Rating  Scale 
Anchors 

Label  the  scale’s  high  end  with  the  most 
fiivorable  anchor 

Content  of  the  question  dictates  the  rating 
scale  and  anchor  used 

Use  the  least  amount  of  different  rating 
scales  possible  in  one  survey 

Response  Bias 

Avoid  scales  that  have  demonstrated 
acquiescmce  bias 

Source:  paraphrased  from  Paul  and  Bracken  (1995, 45-9) 


Specific  Issues  for  Mail  Surveys 

In  the  May  1995  issue  of  American  Demographics.  Kephart  offers  ^ecific 
suggestions  on  how  to  improve  the  efficiency  of  mail  surveys  via  information  from  Katie 
Klopfenstein  ofMarketvision  Research  Inc.  of  Cincinnati,  Ohio:  (1)  use  a  personalized 
cover  letter,  (2)  make  certain  the  questionnaire  is  uncluttered,  (3)  plan  on  conducting 
multiple  mailings,  and  (4)  include  an  incentive  in  the  mail-out.  The  most  inqjortant  of 
these  factors  is  the  suggestion  to  include  respondent  incentives  in  the  mail  survey.  Based 


36 


on  this  article  and  other  information  in  the  literature,  incentives  were  considered 
appropriate  for  mail  surveys  and  actually  unproved  response  rates  without  substantially 
influencing  response  bias.  As  a  result  of  this  information  and  based  on  prior  survey 
e7q)erience  within  the  SETON  network,  the  SHP  President  determined  that  two  incentives 
should  be  added  to  the  survey  package:  a  fresh  one-doUar  bill  and  a  return  postcard 
making  the  respondent  eligible  for  two  free  months  of  health  care  premiums. 

Literature  Pertaining  to  the  Utility  of  the  Findings 
Once  the  data  has  been  collected  and  analyzed,  it  is  inq)ortant  to  identify  \^hat 
value  it  adds  to  customers  in  the  health  care  value  chain.  Four  major  categories  of 
customers  are  the  primary  users  of  survey  results:  (1)  MCOs,  (2)  enq)loyers,  (3)  other  care 
providers  in  the  delivery  process,  and  (4)  health  care  consumers.  Although  the  data  is 
used  for  a  variety  of  purposes.  Table  8  summarizes  the  main  use  of  data  for  the  different 
customer  groups.  As  MCOs  are  the  focal  point  for  this  study,  inqrlications  and  utility  of 
the  finHmg.s  for  MCOs  are  discussed  in  detail 


TABLES 


1  SES  FOR  CUSTOMER  SATISF.\C  TION  DATA 

1 

Purchasing 

X 

X 

X 

QI  Programs 

X 

X 

X 

Accreditation 

X 

X 

Planning 

X 

X 

Resourcing 

X 

X 

X 

Communication 

X 

X 

X 

Marketing 

X 

X 
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Purchasing  Decisions 

Contractual  arrangements  are  an  integral  part  of  most  MCO’s  network 
development  strategy.  Within  this  strategy,  customer  satis&ction  measures  should  play  a 
key  role  in  contract  negotiations  and  arrangements.  MCOs  need  to  ensure  that  suppliers 
of  goods  and  services  along  the  continuum  of  care  are  willing  to  partic^ate  in  all  customer 
satisfiiction  survey  efforts.  This  includes  all  provider  groups,  health  care  fecilities,  and 
service  and  materials  suppliers  for  the  MCO’s  network.  By  measuring  patient  satisfaction 
with  different  aspects  of  care  (Le.,  various  suppliers  in  the  value  chain),  MCOs  can  readily 
identify  those  contracted  suppliers  that  are  adding  relatively  more  value  to  the  network 
and  those  that  are  not.  hi  doing  so,  the  MCO  can  arrange  pricing  and  delivery  structures 
that  are  congruent  with  the  level  of  service  the  MCO’s  customers  perceive  they  are 
receiving  along  the  continuum  of  care  (Moses  1995,  44).  One  of  the  more  common 
applications  in  this  arena  has  been  the  use  of  customer  satisfaction  survey  information  as  a 
criteria  for  physician  contract  renewal  (Gold  and  Wooldridge  1995,  156).  As  summed  up 
by  Dr.  Stephen  Pew  (Bergman  1995,  20),  Senior  EWrector  of  Inq)rovement  Mormation  at 
VHA,  Inc.,  Irving,  Texas,  “Managed  care  organizations  are  paying  increased  attention  to 
subscribers’  satis&ction  with  the  providers  they’ve  chosen.  If  subscribers  aren’t  happy, 
they’re  not  likely  to  become  policy  holders.” 

Quality  Improvement  (Oil  Purposes 

As  with  other  industries,  quality  mq)rovement  has  taken  hold  in  MCOs.  Although 
QI  efforts  in  MCOs  M  along  a  continuum  from  very  limited  QI  programs  to  true  QI 
philosophy,  strategy  and  operations,  MCOs  demonstrating  viability  for  the  future  have 
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started  their  QI  journey.  An  overvs4ehning  drive  to  meet  or  exceed  customer  needs  is 
inherent  in  the  QI  philosophy.  Customer  satisfaction  information  is  one  con5)onent  of 
identifying  these  customer  needs  and/or  expectations. 

Another  emerging  initiative  within  MCO’s  QI  Programs  are  the  “Report  Cards 
that  have  cropped  throughout  the  United  States,  hi  an  effort  to  meet  purchasers 
demands  for  a  method  to  assess  MCO  quality  and  hold  MCOs  accountable  for  the  services 
they  provide,  MCOs  have  started  developing  report  cards  of  their  performance.  Current 
report  cards  in  the  market  are  largely  based  on  NCQA’s  Health  Enqiloyer  Data  and 
Information  Set  (HEDIS)  or  are  self-deagned  by  individual  MCOs.  Regardless  of 
whether  the  NCQA’s  HEDIS  or  a  self-designed  tool  is  used,  the  report  cards  generally 
focus  on  measuring  quality,  access,  patient  satisfaction,  membersh^  and  utilization,  and 
financial  aspects  of  the  MCO.  Despite  the  feet  that  critics  of  the  report  cards  cite 
inaccurate  data  recording  and  reporting  and  a  lack  of  conqiarability  between  non- 
standardized  tools,  the  information  collected  and  measured  under  these  ^sterns  provides 
MCOs  with  valuable  feedback  that  can,  at  a  minimum,  be  used  for  internal  QI  programs 
(Chase  1996,  1[B]).  Externally,  vsMe  remembering  that  results  should  be  reported  with 
some  baseline  measure  for  conq)arison,  MCOs  can  use  the  report  cards  as  marketing  tools 
(Ruth  and  Detmer  1995,  34-36). 

Accreditation  Purposes 

While  MCOs  continue  to  drive  the  integration  of  health  care  financing  and 
delivery,  accreditation  is  rapidly  becoming  a  criteria  for  securing  new  accounts.  Already, 
twelve  major  corporations  (e.g..  Allied  Signal,  Ameritech,  General  Electric)  require 
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NCQA  accreditation  from  the  MCOs  providing  health  benefits  to  their  en5)loyees.  It  is 
antic^ated  this  trend  will  continue  to  rise,  as  suggested  in  a  1994  study  of  54  en^loyers 
reporting  24  percent  that  already  require  their  MCOs  to  be  NCQA  accredited,  and  another 
63  percent  diat  anticq)ate  adding  this  requiremaat  within  the  next  three  years  (Sandrick 
1995,  54).  According  to  David  Nadi,  an  M.D.  at  Thomas  Jefferson  University  in 
Philadelphia,  even  thougji  both  the  Joint  Commisaon  on  the  Accreditation  of  Healthcare 
Organizations  (JCAHO)  and  the  National  Committee  for  Quality  Assurance  (NCQA) 
accredit  networks  and  MCOs,  it  “appears  that  NCQA  has  won  the  public  relations  war” 
for  eoqjloyers’  approval  (Sandrick  1995,  54). 

Strategic  Planning  and  Resourcing 

The  results  from  customer  satisfaction  surveys  can  also  be  used  in  a  MCO’s 
strategic  planning  and  resourcing  processes.  Results  from  customer  satisfaction  surveys 
may  be  used  by  governing  bodies  as  part  of  the  long-term  planning  process.  Althou^ 
work  by  Gold  and  Wooldridge  ( 1995,  156)  suggests  that  surveys  of  new  enroUees  and 
disenrollees  are  being  used  to  support  strategic  planning  efforts,  the  prime  exan^iles  of 
customer  satisfaction  data  being  used  for  such  purposes  is  best  illustrated  in  non-health 
related  industries.  For  exanqile,  the  1993  Malcolm  Baldrige  winner  in  the  small  business 
category,  Ames  Rubber  Corporation,  regular^  uses  the  results  of  their  customer 
satisfaction  surveys  as  a  mechanism  for  resource  allocation  through  the  recommendations 
of  their  customer  satisfrction  team  Furthermore,  this  conq)any  has  fundamentally  ahered 
its  business  structure  as  a  result  of  satisfaction  surveys  by  creating  two  separate  technical- 
services  groups:  one  to  service  the  day-to-day  product  needs  and  one  for  strategic  product 


40 


planning  (Moskal  1994, 40).  Clearly,  the  strategic  planning  and  resourcing  princ^les  used 
by  the  Ames  Rubber  Corporation  can  also  be  used  by  MCOs  for  similar  purposes. 

Communication  Opportunities 

Communicating  the  results  from  customer  satisfrction  surveys  is  one  of  the  best 
public  relations  opportunities  MCOs  have  at  their  disposal  Not  only  does  communication 
of  the  survey  results  send  a  clear  message  that  the  MCO  considers  customer  feedback  vital 
to  their  business,  but  it  also  serves  as  an  education  and  nifr)rmation  tool.  At  a  mntimum, 
the  survey  results  should  be  mailed  to  MCO  subscribers  (Layton  1993,  85).  The  mailing 
should  educate  mrollees  on  how  the  results  affect  them  personally,  and  the  steps  that  they 
can  take  to  positively  hiq)act  their  interaction  with  the  plan  and  its  providers. 

Furthermore,  consumers  diould  be  informed  about  the  steps  the  MCO  intends  to  take  to 
address  areas  of  concern  identified  in  the  survey  and  to  build  upon  areas  of  excellence 
identified  in  the  survey  process.  Li  doing  so,  the  MCO  is  taking  positive  steps  towards 
improving  member  satisfaction  in  the  future. 

Marketing  Purposes 

Dolinsky  and  Caputo  eloquently  summarize  file  various  uses  for  customer 
satisfaction  survey  data.  The  authors  first  suggest  that  the  demographic  data  collected  can 
be  used  to  segment  a  MCO’s  health  care  market.  Then,  they  suggest  that  MCO’s  identify 
their  key  satisfiers  and  develop  competitive  advantages  based  on  the  findings.  By 
differentiating  health  care  products  based  on  satisfrction  within  various  segments,  the 
MCO  can  ensure  more  efficient  and  effective  promotional  strategies.  Lastly,  MCOs  can 
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use  the  infonnEtion.  from  such  surveys  to  identify  members  that  continue  to  stay  with  the 
plan,  trending  their  results  over  time  to  ensure  customer  loyalty  (Dolinsky  and  Caputo 
1990,  36-8). 


Purpose 

The  purpose  of  this  study  is  to  use  the  NCQA  Annual  Member  Health  Care  Survey 
instrument  and  instruction  manual  to  inq)lement  the  survey  process,  conduct  a  baseline 
analysis  and  determine  key  predictors  of  customer  satisfaction  in  the  SHP’s  two  currait 
LOBs  (HMO  and  PPO).  The  proposed  dependent  and  independent  variables  are  identified 
and  operationally  defined  in  Appendix  B.  The  formal  alternate  and  null  hypotheses  for  the 
study  are  detailed  below. 

Hypothesis  One 

•  Hal:  With  less  than  12  months  total  enrollment,  differences  among  LOBs  are 
predictive  of  key  literature  variables  including  overall  customer  satisfection. 

Y(i,2.3  . . .  n)  (Overall  Score)  =  f  (LOB) 

•  Hoi :  With  less  than  12  months  total  enrollment,  differences  among  LOBs  are 
NOT  predictive  of  an  key  literature  variables  including  overall  customer 
satisfrction  measure. 

Y(i^23  . . .  n)  (Overall  Score)  ^  f  (LOB) 
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Hypothesis  Two 

•  Ha2:  Overall  customer  satisfection  for  the  HMO  LOB  is  a  function  of  one  or 
more  independent  variables. 

Y  (HMO  Overall  Customer  Satis&ction  Score)  =  f  (aoU  +  biXl  + 
b2X2  +  . .  .+b„Xn) 

•  Ho2:  Overall  customer  satis&ction  for  the  HMO  LOB  is  NOT  a  function  of 
one  or  more  independent  variables. 

Y  (HMO  Overall  Customer  Satis&ction  Score)  ^  f  (aoU  +  biXl  + 
b2X2  +  . .  .+b„Xn) 

Hypothesis  Three 

•  Ha3 :  Overall  customer  satisfaction  for  the  PPO  LOB  is  a  function  of  one  or 
more  independent  variables. 

Y  (PPO  Overall  Customer  Satis&ction  Score)  =  f  (aoU  +  biXl  + 
b2X2  +  ...+b„Xn) 

•  Ho3 :  Overall  customer  satisfaction  for  the  PPO  LOB  is  NOT  a  fimction  of  one 
or  more  independent  variables. 

Y  (PPO  Overall  Customer  Satisfaction  Score)  *  f  (aoU  +  biXl  + 
b2X2  +  . . .  +b„Xn) 
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CHAPTER  TWO 


METHODS  AND  PROCEDURES 

Subjects 

Potential  subjects  for  this  project  included  all  5,434  enrolled  subscribers  and  their 
eligible  beneficiaries  receiving  health  care  services  through  the  SETON  network  benefits 
package.  Although  the  NCQA  “Sampling  and  Data  Collection  Protocol”  (see  Appends  C) 
instructs  users  to  administer  a  proxy  survey  for  ehgible  beneficiaries  under  the  age  of  18, 
this  guideline  was  not  followed  given  the  lack  of  supporting  literature  and  the  strong 
likelihood  a  single  household  could  potentially  receive  muh^le  surveys.  Of  the  original 
subjects,  the  18  and  older  limitation  reduced  the  data  set  to  3,794  potential  subjects. 

Hata  Sampling.  Collection  and  Purification 
Data  Sampling 

The  NCQA’s  protocol  outlines  the  suggested  procedures  for  the  NCQA  survey 
satcpling  and  data  collection.  To  begin  the  process,  two  separate  data  files  (one  for  HMO 
members  and  one  for  PPO  members)  were  retrieved  from  the  SHP  claims  processing 
software.  The  files  were  combined  into  one  database  that  was  checked  for  thoroughness 
and  accuracy.  The  check  revealed  the  data  extraction  process  resulted  in  the  subscriber’s 
name  being  placed  in  the  name  block  instead  of  the  actual  member  name,  and  that 
members’  whose  coverage  had  been  terminated  were  stiU  included  in  the  data  set.  After 
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discussing  the  issue  with  ^stem  progranmiers,  a  second  retrieval  was  attempted  wiuch 
proved  to  be  successful  Therefore,  two  con^lete  files  with  all  the  necessary  elements  for 
the  3,565  HMO  members  and  1,869  PPO  members  existed.  The  age  criterion  of  age  18 
and  older  was  applied  to  each  of  the  data  files  in  the  database  which  reduced  the  set  to 
3,794  potential  subjects,  2,430  of  which  were  HMO  members  and  1,364  of  which  were 
PPO  members.  As  stipulated  by  the  protocol,  825  members  fi:om  each  distinct  product 
line  were  selected  using  the  random  seed  fiinction  in  the  Statistical  Program  for  the  Social 
Sciences®  (SPSS)  6. 1  for  Windows®  software  package.  Therefore,  34  percent  of  ehgible 
HMO  members  (825/2,430)  and  60  percent  of  eligible  PPO  members  (825/1,364)  were 
selected  for  inclusion  in  the  study.  Once  the  random  seed  function  was  con^leted,  each 
PPO  member  was  assigned  a  survey  number  fi'om  1,000  to  1,824  and  each  HMO  member 
was  asrigned  a  survey  number  fi'om  2,000  to  2,824.  The  HMO  and  PPO  files  were  then 
combined  into  one  master  database  file  which  was  used  for  the  survey  process.  The  initial 
mail-out  included  1,650  total  subjects. 

For  the  initial  mad-out,  surveys  were  distributed  according  to  the  NCQA  protocol 
with  the  following  excqitions:  (1)  a  fi-esh  one-dollar  bill  was  included  in  the  initial  mad-out 
package,  (2)  a  business-reply  postcard  was  included  in  the  survey  materials  making 
members  who  returned  the  survey  and  card  eligible  for  two  fi-ee-months  of  health  care 
premiums,  and  (3)  flat  catalog  envelopes  were  used  instead  of  windowed  envelopes.  As 
discussed  earlier,  the  incentives  incorporated  into  the  survey  process  are  well-grounded  in 
the  literature.  Additionally,  the  response  rate  on  other  SETON  network  enqiloyee-related 
surveys  had  traditionally  been  only  seven  to  ten  percent,  and  senior  leader^p  thought  an 
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incentive  program  would  inq)rove  the  response  rate  without  introducing  substantial  bias. 
As  for  the  change  in  envelope  style,  the  flat  catalog  envelopes  were  less  costfy  in  both  raw 
materials  cost  and  for  the  costs  associated  with  folding  the  survey  materials  to  make  them 
fit  properly  in  the  windowed  envelopes. 

For  the  second  mail-out,  the  package  included  the  personalized  cover  letter,  a 
business-reply  envelope  to  return  the  survey  to  the  SHP  and  the  "health  care  premium 
postcard.”  The  personalized  cover  letter  was  changed  to  remove  the  reference  to  the  one 
dollar  bill  no  longer  included  in  the  survey  package.  Additionally,  the  instant  incentive 
(ie.,  the  one  dollar  bill)  was  not  included  in  the  second  mail-out  package  as  it  was 
considered  inappropriate  to  reward  nonreq)onsive  behavior  with  an  additional  incentive. 
Finally^  the  researcher  made  the  decision  to  include  the  "health  care  premium  postcard  in 
the  second  mailing  as  it  did  not  increase  production  cost,  and  would  only  add  to  postage 
costs  if  the  postcard  was  returned  to  the  SHP.  Sample  mail  pieces  from  all  mail-outs, 
including  the  final  survey  used  for  the  study,  are  located  in  .^pendix  D. 

Data  Collection 

The  three  phase  (six  weeks)  NCQA  procedure  was  followed  for  the  data  collection 
process  except  for  the  following  deviations;  (1)  the  postmark  on  the  return  envelope  was 
used  to  identify  each  return  phase,  (2)  the  replacement  questionnaire  for  non-responders 
was  mailed  at  week  five,  and  (3)  a  total  of 384  surveys  per  product  line  were  not  achieved. 
First,  the  postmark  date  on  the  buaness-reply  envelope  was  used  as  an  identifier  for 
determining  which  phase  the  survey  was  placed  in  as  it  was  returned.  Three  return  phases 
were  designated  that  mirrored  the  sbc  week  mail-out  phase  in  the  NCQA  protocol. 
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Ahhough  the  protocol  does  not  stipulate  that  returned  surveys  should  be  placed  into  a 
return  category,  the  health  care  and  service  industry  literature  does  indicate  differences  in 
responses  may  be  a  function  of  when  a  survey  is  returned.  Therefore,  a  process  for 
identifying  survey  return  seemed  appropriate  for  the  study. 

The  second  deviation  from  the  protocol  occurred  during  the  replacement  mail-out 
for  non-responders.  Due  to  production  problems  with  survey  printing,  mail-out  of 
replacement  surveys  was  delayed  by  one  week.  As  a  resuh,  phase  two  of  the  data 
collection  process  was  actually  three  weeks  compared  to  the  recommended  two  weeks. 

The  final  deviation  during  the  data  collection  phase  was  the  expected  response 
rate.  The  protocol  stipulates  that  384  corrQ)leted  surveys  from  each  product  line  must  be 
collected  for,  “the  data  to  be  considered  statistically  precise”  (NCQA  1995,  32).  Hence, 
the  ejq)ected  return  for  SETON’s  two  product  lines  shoidd  have  been  768  or  more 
p-nwipleted  surveys.  After  the  seven  week  data  collection  period,  338  con:q)leted  HMO 
surveys  and  352  PPO  surveys  had  been  returned.  Even  though  this  did  not  meet  the 
NCQA  recommended  levels  for  statistical  precision,  the  central  limit  theorem  suggests  a 
sample  size  of  30  or  more  is  adequate  for  enabling  the  researcher  to  approximate  a  normal 
distribution.  Additionally,  as  the  sanq>le  size  grows,  the  more  likely  it  is  that  the  sanq)ling 
distribution  of  the  mean  will  approach  a  normal  distribution  (Spatz  1993,  145).  As  such,  a 
potential  sanq)le  size  of  690  total  surveys  (338  HMO  and  352  PPO)  was  conadered 
appropriate  for  the  pmpose  of  this  study. 
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Response  Rates 


The  response  rates  for  tiie  survey  are  sununarized  in  Table  9  and  are  based  on  the 
1,650  initial  surveys  distributed.  The  overall  response  rate  for  the  survey  (44.2%)  was 
considerably  higher  than  e^^ected  for  SETON  employees  (7  to  10%)  based  on  previous 
ejqterience.  It  is  interesting  to  note  that  the  req)onse  rates  for  HMO  members  (43.4%) 
and  PPO  members  (45. 1%)  are  nearly  equal  The  phase  return  rates  for  HMO  and  PPO 
members  are  also  equally  proportioned.  Consequentty,  the  yield  prior  to  data  purification 
was  690  conq)leted  surveys  (338  HMO  surveys  and  352  PPO  surveys).^ 


TABLE  9 


SlIRN  RESPONSE  RATES 

— 

Number  Mailed 

1,650 

825 

825 

Non-deliverable 

4.6%  (76/1,650) 

5.2%(43/825) 

4.0%  (33/825) 

Incorrect  Coverage 

1.0%  (14/1,650) 

<1.0%  (3/825) 

1.3%  (11/825) 

Potential  for  Return 

1,560 

779 

781 

Overall  Returned 

44.2%(690/l,560) 

43.4%  (338/779) 

45.1%  (352/781) 

Phase  1 

59.7%  (412/690) 

61.2%  (207/338) 

58.2%  (205/352) 

Phase  2 

23.3%  (161/690) 

22.8%  (77/690) 

23.9%  (84/352) 

Phase  3 

17.0%  (116/690) 

16.0%  (54/338) 

17.9%  (62/352) 

*  Process  Note;  Fifty-three  (5)  of  the  690  surveys  returned  had  the  original  surv^  identification  number 
either  removed  or  altered.  The  solution;  PPO  members  were  sequentially  assigned  a  new  survey  number 
starting  at  3,000  vtole  HMO  members  were  assigned  a  new  survey  number  starting  at  4,000. 
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Data  Purification 


Once  the  data  collection  period  ended,  the  data  purification  process  started.  The 
process  was  broken  into  four  distinct  stages;  (1)  survey  data  entry  (2)  data  transposition 
and  transformation  (3)  elimination  of  cases  and  variables,  and  (4)  derivation  of  calculated 
variables  (see  Figure  2).  As  acconq)lished  by  the  researcher,  this  process  was  iterative, 
requiring  more  time  and  effort  than  was  antic^ated.  This  could  have  been  prevented  had 
the  researcher  dedicated  more  time  during  the  initial  stages  of  the  research  process  to 
more  succinctly  plan  the  data  file  needed  for  the  analy^  and  hypothec  testing. 


nGURE2 

DATA  PUKIFICATION  PROCESS 
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Derivation  of 
Calculated  Values 


Survey  Data  Entry 

A  custom  database  application  for  data  entry  was  created  using  Microsoft 
Access®.  The  database  possessed  two  features  t^ch  in^roved  data  entry  accuracy;  real¬ 
time  data  vahdation  and  customized  forms  for  data  entry.  The  validation  feature  prevents 
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errors  in  data  entry  by  allowing  the  researcher  to  limit  the  data  entry  to  only  those 
numeric  values  from  each  individual  survey  question.  For  exan^le,  question  eleven  from 
the  survey  asks  the  respondent  to  rate  his  or  her  overall  satisfection  with  the  health  plan 
using  a  seven-point  response  scale.  The  validation  feature  used  for  this  question  onty 
allows  the  data  entry  person  to  enter  a  “1  -  7”  or  “99  for  no  re^onse”.  hi  addition  to  the 
vahdation  feature,  the  database  also  permits  the  creation  of  a  custom  data  entry  form 
v\diich  makes  data  entry  more  intuitive  and  reduces  data  entry  training  time,  .^pendix  E 
has  san^le  printouts  portraying  these  features. 

To  fiirther  frcihtate  data  accuracy,  data  entry  was  conducted  in  “real  time”  over  a 
nine  week  period  for  three  hours  daily.  This  ensured  that  data  entry  was  not  hurried  and 
allowed  the  researcher  to  check  each  record  twice  during  initial  entry.  Moreover,  the 
researcher  spot  checked  ten  percent  of  all  690  records  prior  to  accomplishing  any  data 
transposition  or  transformation.  By  using  the  database  features  and  data  entry  quality 
checks,  the  researcher  inqiroved  the  quality  of  data  by  preventing  inadvertent  data  entry 
errors. 

The  last  st^  for  survey  data  entry  was  to  develop  the  SPSS  6. 1  for  Windows®  file 
needed  for  completing  the  statistical  analysis.  This  step  was  conqileted  by  importing  the 
database  file  into  a  spreadsheet,  and  then  inqiorting  the  spreadsheet  file  into  SPSS  6. 1  for 
Windows®.^  All  data  entries  from  the  690  surveys  (cases)  returned  were  successfully 
entered  uito  the  statistical  sofiware. 


^  Process  Note:  All  survey  questions  were  coded  “99  =  no  response”  (height  and  weight  variables  were 
coded  “999  =  no  response”). 

^  Process  Note:  Use  Lotus®  for  these  steps.  Microsoft  Excel®  drops  the  last  case  vhen  it  imports  data 
into  SPSS  6. 1  for  Windows®.  Also,  SPSS  6. 1  would  not  accept  all  690  record  simultaneously,  therefore, 
(continued) 
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Data  Transposition  and  Transformation 

Tbe  proposed  variable  list  discussed  in  the  “Purpose”  section  of  this  paper  was  the 
starting  point  for  all  variable  transpositions  and  transformations.  Table  10  outlines  the  raw 
variables  that  were  transposed  for  data  analysis  purposes.  As  suggested  in  the  literature 


TABLE  10 


separate  Lotus®  files  for  the  PPO  and  HMO  groups  were  created,  imported  and  then  combined  in  SPSS 
6.1.  for  Windows® 
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and  as  outlined  in  other  surveys  (e.g.,  GHAA  Survey),  the  highest  value  from  the  scale 
was  associated  with  the  most  fiivorable  outcome  or  req)onse.  B^olar  scale  variables  that 
met  an  ordinal  level  definition  were  considered  interval  level  data  for  analysis  pmposes 
based  on  the  ordinal-interval  assumption.  Sin[q)ly  stated,  this  assun^tion  requires  the 
consent  assignment  of  numbers  to  the  properties  of  persons,  objects  or  events  and  the 
meaningfiil  categorization  of  such  data  in  order  to  study  quantitative  relationdi^s  among 
variables  (Knapp  1990, 121-3).  The  use  of  such  an  assumption  allows  the  researcher  to 
use  parametric  statistics  for  a  more  meaningful  analysis.  Mathematical  statistics  literature 
clearly  indicates  that  scale  properties  are  not  a  requirement  for  the  use  of  various  statistical 
procedures,  and  that  empirically  it  matters  little  if  ordinal  scale  data  is  treated  as  interval 
data  (Gaho  1980,  564-7). 

Table  1 1  outlines  the  data  transformations  for  study  variables.  As  opposed  to  data 
transpo^on,  transformation  involves  a  change  in  the  data’s  fimdamental  mformation. 

The  most  in:q)ortant  items  to  consider  among  this  set  are  those  questions  which  were  data 
dependency  questions*  In  essence,  these  questions  should  not  have  responses  circled 
unless  q)ecific  criteria  were  met  in  the  preceding  question(s).  As  an  exan[q)le,  survey 
respondents  answering  “no”  to  both  parts  of  question  five,  should  not  have  responded  to 
question  sfac  In  these  cases,  the  deciaon  was  made  to  recode  the  data  to  a  “pure  state”  by 
creating  migging  values  in  the  data  set  if  the  stated  criteria  were  not  met.  Unfortunately, 
this  approach  lead  to  dgnificantly  lower  response  rates  for  these  variables  compared  to  all 

Process  Note;  Although  the  second  part  of  question  three  (3a)  was  a  data  dependency  question,  the 
recent  acquisition  of  the  city  hospital  lead  the  researcher  to  not  transform  this  variable.  As  with  these 
types  of  questions,  the  descriptive  statistics  were  reported  separately  and  the  question  (variable)  was  not 
used  in  any  inferential  statistic  analysis. 
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other  raw  variables.  However,  this  was  the  most  sound  decision  for  preventing  the 
introduction  of  unwanted  errors  into  the  data  set.  For  the  data  dependency  variables 
remaining  after  the  data  purification  process  was  complete,  the  descriptive  statistics  were 
reported  sq)arately  and  the  variables  were  not  used  for  inferential  statistical  analysis. 

TABLE  11 


DATA  TRANSFORMATION 

6 

If  (5a  =“no”  or  “missing)  and  (5b  -  fro”  or  “missing”)  then  6  = 
“missing” 

10a 

If  (10  =‘fro”  or  “missing”),  then  10a  =  ‘friissing” 

29(3)b 

If  (29(3)a  =  ‘fro”  or  “missing”),  then  29(3)b  =  missing 

29(4) 

If  (29(3)a  =  ‘fro”  or  “missing”),  then  29(4)  =  missing 

If  (29(3)a  =  “yes”  and  29(3)b  =  “yes”),  then  29(4)  =  missing 

29(6) 

If  (29(5)a  through  29(5)e  =‘fro”  or  “missing”),  then  29(6)  = 
missing 

Age 

“Date  of  birth”  transformed  to  “age” 

Once  these  steps  had  been  conq)leted  for  all  690  records  (surveys),  the  descr^tive 
statistics  (mean,  standard  deviation,  minimum  and  maximum  values  and  valid  N)  and 


frequencies  were  calculated  for  all  raw  variables.  These  statistics  were  then  used  to 
determine  outliers  in  the  data  set.  Once  the  outliers  were  identified,  values  in  the  data  file 
were  checked  against  the  responses  from  the  actual  survey  and  corrections  were  made  as 
necessary  (see  Table  12).  As  a  result  of  this  data  check,  the  potential  survey  set  was 
reduced  to  689  because  one  record  had  a  respondent  age  of  13  years  vriiich  violated  the 
age  criterion  estabUshed  at  the  onset  of  the  study. 
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TABLE  12 


DATA  SEl  OI  TIJFRS 

ill  II  IHiliiil^^P  Sli  l|lllllllli^^™l 

1200 

Weight  entered  320  lbs;  correct,  NO  CHANC$ 

1683 

Age  entered  13;  correct,  REMOVE  FROM  DATA  SET 

2030 

Weight  entered  1  lbs;  correct,  REPLACE  WITH  MEAN 

2356 

Weight  entered  325  lbs.;  correct,  NO  CHANGE 

2374 

Height  entered  50  in. ;  correct,  NO  CHANGE 

2524 

Weight  entered  35  lbs.;  incorrect,  CHANGE  TO  135  lbs. 

F.limination  of  Cases  and  Variables 

Based  on  the  descr^tive  statistics  and  frequency  set  fi>r  689  surveys,  a  series  of 
analyses  were  run  to  determine  wfrat  cases  should  be  excluded  from  the  data  set.  First,  the 
count  function  in  SPSS  6. 1  for  Windows®  was  used  to  determine  the  percentage  of  raw 
variables  (questions)  that  were  conq)leted  for  each  individual  case  (survey).  The  next 
step  was  to  determine  the  listwise  percentages  conq)leted  (i.e.,  the  percentage  coiiq)leted 
for  each  raw  variable  across  all  cases).  Once  these  two  steps  were  fimshed,  the  resuhs 
were  searched  for  trends  and  further  analysis  was  conducted  as  outlined  in  Appendix  F. 
Based  on  the  analy^,  the  decision  was  made  to  delete  all  cases  from  the  final  data  set  that 
had  less  than  75  percent  of  the  raw  variables  conq)leted,  leaving  a  final  data  set  with  61 1 
cases  (n  =  611). 

To  determine  the  variables  that  would  be  eliminated  from  the  final  data  set,  the 
listwise  percentages  were  calculated  using  the  new  data  set  (n=61 1).  Using  an  assumption 
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that  variables  wiiggmg  greater  than  10  percent  of  their  responses  were  either  the  result  of  a 
poorly  worded  question,  or  the  question  was  not  of  great  enough  in^ortance  for  this 
sample  population  to  answer,  variables  were  deleted.  Table  13  indicates  the  raw  variables 
that  were  deleted  from  the  study. 


TABLE  13 


ELI.MINATION  OF  INDIMDI'AL  \  ARIABLES 

ill  im 

5a 

Visits  received  out-of-network 

>  10%  missing 

5b 

Hospital  stays  out-of-network 

>  10%  missing 

6 

Reason  care  sourght  outside  the  network 

>  10%  mis^g 

9c 

Ability  to  get  a  specialist  referral 

>  10%  missing 

15b 

Wait  time  for  minor  iUness 

>  10%  mis^g 

15c 

Wait  time  for  chronic  iUness 

>  10%  mis^g 

15d 

Wait  time  for  urgent  illness 

>  10%  mis^g 

29(3)b 

Exercising  at  personal  best  level 

>  10%  mis^g 

29(4) 

Reason  not  exercising  regulaily 

>  10%  missing 

Of  the  variables  deleted  from  the  set,  the  elimination  of  those  questions  related  to 


the  use  of  health  services  (questions  #5a,  #5b  and  #6)  and  wait  times  (questions  #15a, 
#15b  and  #15c)  represent  the  loss  of  valuable  information  for  the  health  plan.  Speculating 
on  the  reason  why  these  questions  were  left  unanswered,  the  researcher  believes  that 
limited  time  (i.e.,  seven  months)  survey  participants  had  in  the  program  tremendously 
impacted  their  comfoit  with  answering  the  questions.  Many  survey  participants 
commented  in  the  survey  margins  that  they  had  no  basis  for  answering  these  particular 
questions  and  that  a  “hot  applicable”  answer  was  not  included.  Further  iterations  of  the 
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survey  diould  he^  detenniiie  ^^lether  the  hunted  enrolhneiit  contributed  to  these 
questions  being  left  unanswered. 

Derivation  of  Calculated  Values 

For  variables  that  were  time-related  or  bin  categories,  the  decirion  was  made  to 
use  mutually  exclusive,  categorically  exhausted  (MECE)  or  “dummy”  variable  data  sets. 
This  decision  was  largely  based  on  recent  developments  in  parametric  statistics,  modeling 
and  prediction  uang  generalized  line  models  (Baxter  1990)  that  requires  extensive  use  of 
categorical  or  “dummy”  variables  (Ward  &  Jennings,  1973;  Kerlinger,  1986;  Kerlinger  and 
Pedhazur,  1973;  Pedhazur,  1982;  Cohen  and  Cohen,  1983;  Edwards,  1979,  1984).  The 
use  of  such  an  approach  provides  more  meaningful  information  as  the  proportion  of  group 
membership  for  each  bin  and  its  fimctional  relationshq)  to  the  dependent  variable  is  more 
clearly  defined. 

Once  the  “dummy”  variables  had  been  created,  decisions  regarding  missing  values 
were  made  for  the  data  set.  Since  all  variables  remaining  in  the  data  set  had  ten  percent  of 
less  missing  values,  the  researcher  decided  to  replace  the  missing  values  with  the  variable’s 
mean.  This  criterion  was  discussed  with  the  consulting  statistician  and  was  determined  to 
be  acceptable  practice. 

The  last  step  in  the  data  derivation  process  was  to  create  another  set  of  derived 
variables:  roll-up  variables.  This  set  of  variables  was  derived  by  summing  the  values  of  all 
related  sub-questions.  If  the  vahdity  of  these  summed  variables  is  established,  then  the 
roll-up  variable  can  be  appropriately  used  for  inferential  statistical  analysis,  ultimately 
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reducing  the  number  of  variables  without  losing  meaningfiil  information.  Table  14 
summarizes  the  derived  variables  for  the  study. 


TABLE  14 


i)erim:i)  \  ariables 


Question  Min.  Max. 

Question  #  7  15  75 

Question  #8  7  35 

Question  #9  3  9 

Question  #27  0  5 

Question  #28  0  12 

Question  Number  of  MECEs 

4a,  4b,  18,  36  4 

2,  16,  33,  34  5 

35  6 

15a,  17  7 

Description  of  the  Final  Data  Set 

The  persons,  objects  or  events  used  in  this  study  are  611  NCQA  Member 
Satis&ction  surveys  (n  =  61 1)  originating  from  a  sanq)le  of  SETON  network  en5)loyees, 
age  18  years  or  older,  eligible  for  the  SETON  health  benefits  package,  reading  in  central 
Texas.  Of  the  611  surveys,  303  respondents  were  enrolled  in  the  HMO  line-of-business 
and  308  were  enrolled  in  the  PPO  Kne-of-business.  i^pendix  G  outlines  the  final  variable 
list  and  includes  the  operational  definition  for  each  variable. 

Reliability  and  Validity 

Reliability  and  validity  are  key  conq)onents  of  any  study  which  must  be  addressed. 
Kerlinger  (1986)  suggests  that  the  main  technical  fimction  of  research  and  design  is  to 


control  variance.  As  such,  he  offers  the  “Maxmincon”  princ^le  as  an  effective  starting 
porition  for  controlling  variance  in  the  research  process.  This  princ^le  is  eicployed  during 
research  design  and  entails  three  parts:  (1)  maxhnizing  the  variance  of  variables,  (2) 
tninimizmg  the  enor  or  random  variance,  including  so-called  errors  of  measurement,  and 
(3)  controlling  the  variance  of  extraneous  or  “unwanted”  variables  that  may  have  an  effect 
on  the  experimental  outcomes.  Ultimately,  these  principles  try  to  control  the  variance  of 
the  dependent  variahle(s)  after  the  study  has  been  done. 

Several  steps  were  takoi  to  maximize  the  variance  of  variables  used.  The  starting 
point  was  the  extensive  variable  list  used  in  the  study.  Where  possible,  variables  were 
kept  in  the  study  as  long  as  they  met  the  equal  to  or  less  than  10  percent  missing  values 
criterion.  Additionally,  uring  the  largest  sanq)le  size  feasible  within  the  study’s  parameters 
for  quality  was  also  a  key  conq>onent  of  maximizing  variable  variance.  Of  the  689 
potential  surveys  for  inclusion  in  the  study,  greater  than  88%  (n=61 1)  were  incorporated 
into  the  final  data  set. 

There  were  several  possible  sources  of  error  that  may  have  threatened  the  validity 
of  the  study.  First,  respondent  error,  or  that  error  caused  by  respondents  incorrectly 
reporting  information,  may  have  influenced  the  study.  Second,  error  could  have  occurred 
during  the  initial  data  extraction.  Third,  e)q)erimenter  error  could  have  affected  the  study 
if  data  was  entered  incorrectly  into  the  database  used  for  storing  survey  responses. 

Fourth,  additional  experimenter  error  could  also  have  been  introduced  in  the  data 
transformation  process.  As  discussed  earlier,  numerous  quality  checks  were  built  into  the 
data  sampling  and  collection  process  which  should  have  limited  these  sources  of  error. 
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The  extraneous  or  “unwanted”  variables  in  the  study  were  controlled  by  the 
extensive  study  variable  list.  One  key  to  limiting  extraneous  variables  was  the  extensive 
testing  the  NCQA  conducted  to  determine  \)vWch  variables  would  be  incorporated  into  the 
survey  msaninient  Variables  were  onfy  included  in  the  final  survey  instrument  if  they 
passed  rigid  reliability  and  validity  standards.  The  inchidon  of  health  care  customer 
satisfection  measures  for  health  services,  management  of  services,  range  of  services,  health 
status,  demographics  and  other  a^ects  of  care  into  the  survey  instrument  he^ed  reduce 
the  number  and  uiq)act  of  unwanted  survey  variables. 

To  fintnpleTnent.  the  more  qualitative  nature  of  the  “Maxmincon  Princ^le," 
quantitative  steps  were  taken  to  ensure  the  reUability  and  validity  of  the  MECE  and  roll-up 
variables.  The  probabilities  of  the  MECE  variables  coded  zero  or  one  were  totaled  to 
ensiure  the  summed  probabilities  equaled  one.  For  each  of  the  roll-up  variables,  a  wdiole- 
part  correlation  matrix  was  accott^lished.  The  results  of  these  matrices  are  diown  in 
./^pendix  H.  After  referring  to  named  appendix,  note  that  for  all  roll-up  variables  the 
actual  probabilities  are  g  <  .05  indicating  validity  between  the  given  construct  and  its 
subparts.  Since  reliability  is  a  necessary  for  but  not  sufficient  condition  for  validity,  the 
vahdity  established  between  the  construct  and  its  related  questions  allows  one  to  assume 
reliability. 

Ethical  Concerns 

Ethical  considerations  are  particularly  salient  throughout  the  survey  and  analysis 
process.  The  NCQA  protocol  does  not  guarantee  anonymity  for  survey  respondents; 
however,  it  does  instruct  survey  administrators  to  inform  respondents  that  their  answers 
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are  strictly  confidential  (NCQA  1995, 12).  Four  steps  were  taken  to  ensure  re^ondent 
confidentiality.  First,  the  SETON  network  Benefits  Manager  was  contacted  to  make  sure 
that  all  SETON  en5)loyees  had  signed  an  information  release  form  during  their  enrollment 
in  the  health  benefits  program.  As  suspected,  enrollees  had  agned  a  release  form  allowing 
the  SETON  network  to  use  information  for  quality  assurance  purposes.  Second, 
respondents  were  informed  that  their  answers  were  confidential  on  the  first  page  of  the 
survey.  Third,  the  mail-out  database  containing  re^ondent  mformation  was  kept  separate 
from  all  other  survey  files,  histead,  of  using  the  survey  rec^ient’s  personal  information 
for  data  tracking,  a  distinct  survey  number  was  assigned  to  each  rec^ient.  Only  the 
primary  researcher  had  access  to  the  file  connecting  the  survey  rec^ient  to  the  survey 
number.  Finally,  the  surv^  administrator  was  not  a  SETON  enq)loyee  and  had  no  formal 
affiliatimrfi  with  the  SETON  network  outside  its  use  as  a  training  she.  By  following  the 
NCQA’s  guidelines  and  building  additional  steps  into  the  process  to  guarantee  respondait 
confidentiality,  the  parameters  established  by  NCQA  have  been  met  for  this  study. 

Statistical  Analysis  Used  in  the  Study 

The  statistical  tests  to  be  conducted  for  this  study  are  based  on  the  hypotheses 
testing  for  the  hypotheses  outline  in  the  “Purpose”  section  of  the  paper.  All  statistical 
tests  or  analysis  were  establi^ed  at  the  ct  <  .05  level,  although  exact  probabilhies  are 
reported  A^aiever  possible. 

Hypothec  One  (H*!) 

•  Hal:  To  begin  the  analysis  for  Hal,  the  descriptive  statistics  for  the  entire  sanq)le  (n  = 
61 1)  are  given.  Addhionally,  the  statistically  significant  correlations  between  line-of- 
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bu^ess  (LOB)  and  all  other  variables  for  the  entire  sanq)le  are  highlighted.  The 
inferential  statistic  of  choice  for  HI  will  be  the  Student’s  t-test  for  the  mean 
differences  between  two  separate  group  means.  In  this  test,  the  means  between  a 
variety  of  dependent  variables  (Y(i^3 . . .  n))>  with  the  primary  study  variable  of  overall 
customer  satis&ction  being  the  most  m^ortant)  and  the  independent  variable  (X)  of 
plan  type  (1  =  HMO  and  0  =  PPO)  will  be  con^ared. 

Hypothecs  Two  (Ha2) 

•  Ha2:  To  analyze  Ha2,  the  descr^tive  statistics  for  the  HMO  subsan:q)le  (n  (hmo)  =  303) 
are  given.  Additionally,  the  statistically  significant  correlations  between  HMO  overall 
customer  satis&ction  and  all  other  variables  for  the  HMO  san^>le  are  highhghted.  The 
inferential  statistic  of  choice  is  fiill  model,  stepwise  multiple  linear  regression  (MLR). 
The  dependent  variable  (Y)  will  be  overall  HMO  customer  satis&ction  and  the 
independent  variables  (Xi,23. .  .n)  will  be  based  on  the  results  from  the  HMO  corre&tion 
matrix  and  key  literature  var&bles.  From  the  stepwise  regresaon,  a  statistically 
significant  model  should  emerge  that  explains  the  shared  variance  among  variables  and 
has  predictive  capabihties. 


Hypothesis  Three  (Ha3) 

•  Ha3;  To  analyze  Ha3,  the  descriptive  statistics  for  the  PPO  subsanq)le  (n  (ppo)  =  308) 
are  given.  Additionally,  file  statistically  significant  correktions  between  PPO  overall 
customer  satis&ction  and  aU  other  variables  for  the  PPO  sanq)le  are  highhghted.  The 
inferential  statistic  of  choice  is  full  model,  stepwise  multiple  linear  regression  (MLR). 
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The  dependent  variable  (Y)  will  be  overall  PPO  customer  satisfaction  and  the 
independent  variables  (Xu3. .  n)  will  be  based  on  the  results  from  the  PPO  correlation 
matrix  and  key  literature  variables.  From  the  stepwise  regression,  a  statistically 
significant  model  should  emerge  that  ejqjlains  the  shared  variance  among  variables  and 
has  predictive  capabilities. 


62 


CHAPTER  THREE 


RESULTS 

Based  on  the  statistical  analyses  outlined  above,  the  following  results  are  reported 
for  each  of  the  study’s  three  hypotheses.  Given  the  large  number  of  variables  in  the  study, 
the  descriptive  statistics  for  the  entire  san5)le  (n=61 1)  and  each  subsan5)le  (HMO  and 
PPO)  are  annotated  in  .^pendix  I. 

Hypothesis  One  Results 

Based  on  the  descr4)tive  statistics,  the  entire  sample  (n  =  61 1)  is  predominantly 
female  (74%),  Caucasian  (79%),  married  (62%),  and  has  at  least  some  college  or  other 
formal  education/training  after  high  school  (89%).  The  population  also  has  a  fairly 
Ifispanic  membership  (16%).  hi  regards  to  their  health  status,  the  sanq)le 
population  considers  their  overall  health  status  to  be  “good”  to  “very  good”,  although  a 
moderate  amount  report  some  form  of  tobacco  (20%)  use  and  regular  exercise  (49%). 
Furthermore,  the  sample  population  also  feels  their  health  is  about  the  same  as  it  was  one 
year  ago.  Interestingly,  a  large  portion  of  the  population  (76%)  identified  their  enrolled 
timo  as  less  than  one  year.  The  san(q)le  population  is  between  “neither  satisfied  nor 
dissatisfied”  and  “somewhat  satisfied”  with  their  health  plan  (4.64  on  a  scale  fiom  1  to  7), 
feels  their  health  plan  has  “stayed  about  the  same”  over  the  last  12  months  (2.97  on  a  scale 
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from  1  to  5)  and  is  wavering  on  recommending  their  plan  to  femily  or  friends  (2.71  on  a 
scale  from  1  to  4). 

TABLE  15 


CORRELATIONS  AMONG  STUDY  VARIABLES  FOR  H.!: 
FINDINGS  BETWEEN  PLAN  TYPE  AND  OTHER  STUDY 


SIGNMCANT 

VARIABLES 


0.09  * 

0.25  ** 
0.09  ♦ 

-0.08  * 
-0.12  ** 
-0.10  * 
0.09  * 

0.08  ♦ 
-0.09  * 

-0.09  * 

0.13  ** 
-0.15  ♦* 
0.14  ♦* 
0.08  * 
0.15  ♦♦ 
0.09  * 


Significance  Levels :  (*)  p  <  .05,  (**)  p  <  .01,  n  -  611 


Table  15  displays  the  statistically  significant,  p  <  .05,  correlations  that  were  found 
for  plan  type  and  all  other  study  variables.  Uang  these  relationships  as  a  foundation  and 
coupling  them  with  key  literature  variables,  the  following  variables  were  tested  and  fotmd 
to  have  the  statistically  significant  relationsh^s  outlined  in  Table  16.  Overall,  it  can  be 
generalized  that  these  study  results  support  differences  between  the  HMO  and  PPO  LOBs 
in  relation  to  various  a^ects  of  customer  satisfrction  identified  in  the  health  care 


literature. 
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TABLE  16 


INFERENTIAL  STATISTICS  FOR  H3I:  STUDENTS  T-TEST  FOR 

_ INDEPENDENT  GROUP  MEAN _ 

i^O  HMO 


Variable  Tested  as  Y _ 

Y  (q7_totaI)  Piealth  care] 
Y(q8_total)  [plan  administration 
Y(q9_total)  [mgmt  of  care] 
Y(sat&_ll) 

Y(perfm_12) 

Y(recmd_13) 

Y(age) 

Y(hspnc_32) 

Y(q33_2)  [Caucasian] 

Y(q33_3)  [Asian] 

Y(q33_4)  [Native  American] 
Y(q33  5)[Other] _ 


n  =  308  n  =  303 


Mean 

S.D. 

Mean 

S.D. 

df 

t-test 

P 

54.27 

11.50 

50.00 

12.96 

609 

4.30 

.000 

19.92 

5.42 

22.23 

5.27 

609 

-7.01 

.000 

5.53 

0.85 

5.24 

1.21 

609 

3.46 

.001 

4.51 

1.53 

4.78 

1.47 

609 

-2.29 

.022 

2.76 

0.86 

3.18 

0.79 

609 

-6.34 

.000 

2.63 

0.83 

2.79 

0.87 

609 

-2.28 

.023 

43.07 

10.67 

41.05 

11.58 

609 

2.24 

.026 

0.12 

0.32 

0.21 

0.41 

609 

-3.23 

.001 

0.85 

0.35 

0.73 

0.44 

609 

3.81 

.000 

0.00 

0.00 

0.04 

0.19 

609 

-3.39 

.001 

0.00 

0.00 

0.01 

0.11 

609 

-2.02 

.040 

0.06 

0.22 

0.14 

0.35 

609 

-3.77 

.000 

Hypothesis  Two  Results 

The  descrqjtive  statistics  for  the  HMO  subsample  (n  =  303)  give  nearly  the  same 
picture  as  the  one  presented  for  the  entire  san:q)le  population.  However,  the  HMO 
giihsample  has  sli^tly  fewer  females  and  sli^tly  more  Hispanics  (71%  and  21% 
respectively).  Additionally,  a  much  larger  section  of  the  HMO  subsanq)le  reported  being 
in  their  new  plan  less  than  one  year  (90%).  Observations  regarding  health  status  and 
satis&ction  with  care  mirror  the  entire  sample  with  two  exceptions:  (1)  the  HMO 
population  reports  greater  satis&ction  for  overall  customer  satisfection  than  the  total 
sanq)le  population  (4.78  versus  4.64)  and  (2)  they  are  more  inclined  to  believe  that  their 
health  plan  has  improved  over  the  last  12  months  when  compared  to  the  total  san[q)le 
(3.18  versus  2.71). 
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Hypothesis  two  postulated  that  HMO  customer  satis&ction  was  a  function  of  one 
or  more  independent  study  variables.  Table  17  diq)lays  the  statistically  significant,  p  < 

.05,  correlations  for  the  HMO  subsan^le  overall  customer  satisfection  variable  (satfii_l  1) 
and  all  other  study  variables.  Using  stepwise  regression,  these  statisticalty  significant 
relationsh^  formed  the  foundation  for  a  testable  regression  equation: 

Ha2:  Y(SATFN_1 1)  =  a„U  +  (biLOC2_l  +  b2LOC2_2  +  b3LOC2_3  + 
b4LOC2_4)  +  b5Q7_TOTAL  +  b6Q8_TOTAL  +  b7Q9_TOTAL  +  b8CMPLN_10  + 
b9PERFM_12  +  bioRECMD  lS  +  bnSWTCH_14  +  (b^QlSA  1  +  bnQlSA  2  + 
bi4Q15A_3  +  bi5Q15A_4  +  bi6Q15A_5  +  bi7Q15A_6)  +  (bi8Q16_l  +  b,9Q16_2  + 
b2oQ16_3  +  b2iQ16_4)  +  (b22Q17_2  +  b23Q17_3  +  b24Q17_4  +  b25Q17_5  + 
b26Q17_6  +  b27Q17_7)  +  (b28Q18_l  +  b29Q18_2  +  b3oQ18_3)  +  b3iKIND_21B  + 
b32PAIN_23  +  b33BLUE_24C  +  b340NEYR_26  +  b35CA_27D  +  b36Q28_TOTAL 
+  b37CHW29  5D  +  b38HSPNC_32 

For  the  purpose  of  the  stepwise  regression  function  in  SPSS  6. 1  for  Windows®,  one  of 
the  linearly  dependent  variables  firom  each  MECE  set  in  the  equation  was  manually 
excluded  from  the  stepwise  regression.  Additionally,  given  the  validity  of  all  roU-up 
variables  established  earUer  in  the  study,  totals  were  submitted  for  the  individually 
associated  variables  whenever  pos^le  and  appropriate  to  the  hypothesis  testing. 
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TABLE  17 


CORRELATIONS  AMONG  STUDY  VARIABLES  FORH,2:  SIONfflCANT 
FINDINGS  BETWEEN  HMO  OVERALL  SATISFACTION 


satfii_ll 

Variables  r 

sig 

sat&ll 

Variables  r 

sig 

satfttll 

Variables  r 

sig 

loc2  4 

■IQ 

* 

stfet_7o 

0.46 

ql6_2 

0.26 

loc2  5 

■H 

♦ 

q8  total 

0.62 

ql6_5 

-0.25 

q7  total 

0.65 

range_8a 

0.58 

ql7_2 

0.23 

q7a  k 

0.68 

adin^8b 

0.52 

9):  sic 

ql7_4 

-0.14 

* 

q71  0 

0.47 

cstin_8c 

0.41 

ql7_5 

-0.19 

* 

aptez  7a 

0.54 

usein_8d 

0.48 

ql7_7 

-0.15 

* 

apttmTb 

0.46 

pprtm_8e 

0.37 

ql8_l 

0.15 

* 

trmt_7c 

0.53 

ptprm_8f 

0.43 

ql8_3 

-0.13 

* 

verbl_7d 

0.49 

ptoop_8g 

0.43 

3ies(( 

ql8_4 

-0.24 

mdchc_7e 

0.56 

q9_total 

0.65 

kind_21b 

-0.13 

* 

mdez  7f 

0.53 

afeaic 

delay_9a 

0.55 

pain_23 

0.16 

time_7g 

0.48 

dfclt_9b 

0.61 

blue_24c 

0.19 

outcmTh 

0.53 

cnq)ln_10 

-0.28 

oneyr_26 

0.14 

♦ 

needs_7i 

0.59 

perfin_12 

0.48 

ca_27d 

-0.12 

♦ 

coord_7j 

0.63 

recmd_13 

0.75 

q28_totl 

-0.15 

svsat_7k 

0.65 

swtch_14 

-0.66 

back_28d 

-0.16 

mdnce_71 

0.39 

ql5a_2 

0.14 

♦ 

chw29_5d 

-0.21 

stfok_7m 

0.46 

3|e)ic 

ql5a_6 

-0.16 

hspnc_32 

0.13 

♦ 

mdsnt  7n 

0.42 

ql5a  7 

-0.20 

Significance  Levels :  (*)  p 

<.05,  (**)p<.01,n  = 

303 

Table  18  summarizes  the  result  of  the  MLR  for  Ha2  vshich  clearly  demonstrates 
nine  variables  (willingness  to  recommend  the  plan  [RECMD  IS],  management  of  care 
roll-up  [Q9_TOTAL],  health  services  roll-up  [Q7_TOTAL],  intention  to  switch 
[SWTCH_14],  in:q)rovement  in  plan  performance  in  one  year  [PERFM_12],  the  use  of 
chewing  tobacco  [CHW29_5D],  feeling  blue  |BLUE_24C],  self-doctor  reported  cancer 
[CA_27D]  and  plan  administration  [Q8_TOTAL])  are  strongly  predictive  of  HMO  overall 
customer  satis&ction.  As  indicated  in  the  table,  the  fiill  model  yields  an  R^  of  .7355,  with 


F(9, 293)  =  90.52,  p  <  .0000.  The  unique  for  each  variable  in  the  model  is  also 
annotated. 


TABLE  18 


INFERENTIAL  STATISTICS  FOR  H,2: 
PREDICTORS  OF  OVERALL  HMO  SATISFACTION 


Effects  Tested 

R2Full 

Model 

R2 

Restricted 

dfl 

d£2 

F-ratio 

_-E _ 

recmd  13 

.5607 

.5607 

1 

301 

384.22 

.0000 

q9  total 

.6353 

.0746 

2 

300 

261.35 

.0000 

q7  total 

.6788 

.0435 

3 

299 

210.64 

.0000 

swtch_14 

.6953 

.0165 

4 

298 

169.99 

.0000 

per&a_12 

.7101 

.0148 

5 

297 

145.49 

.0000 

chw29_5d 

.7165 

.0064 

6 

296 

124.68 

.0000 

blue_24c 

.7233 

.0068 

7 

295 

110.14 

.0000 

ca_27d 

.7297 

.0064 

8 

294 

99.22 

.0000 

q  8  total 

.7355 

.0058 

9 

293 

90.52 

.0000 

IL2;  aoU  +  birecmd_13  +  b2q9_total  +  bsqTjtotal  +  b4swtch_14  + 

b5perfin_12  +  b6chw29_5d  +  b7blue_24c  +  b8ca_27d  +  b9q8_total 


Hypothesis  Three  Results 

The  descr^tive  statistics  for  the  PPO  subsanq)le  (n  =  308)  give  nearly  the  same 
picture  as  the  one  presented  for  the  entire  sanq)le  population.  However,  the  PPO 
siihsample  has  slightly  more  females  and  slightly  fewer  Hispanics  (78%  and  12% 
respectively).  In  contrast  to  the  san[q>le  and  HMO  populations,  a  much  smaller  section  of 
PPO  subsan^le  reported  being  in  their  new  plan  less  than  one  year  (61%).  Observations 
regarding  health  status  and  satis&ction  with  care  mirror  tire  entire  sanqrle  with  two 
exceptions:  (1)  the  PPO  subsample  reports  lower  satisfaction  for  overall  customer 
satis&ction  than  the  total  sanqrle  population  (4.51  versus  4.64)  and  (2)  the  PPO 
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subsan5)le  is  less  inclined  to  think  that  their  health  plan  has  improved  over  the  last  12 
months  (2.76  versus  2.97). 


TABLE  19 


CORRELATIONS  AMONG  STUDY  VARIABLES 
FOR  H,3:  SIGNIHCANT  FINDINGS  BETWEEN  PPO 
OVERALL  SATISFACTION  AND  OTHER  STUDY  VARIABLES 


Variables 

satfii_ll 

r 

ag 

Variables 

satfii_ll 

r 

sig 

loc2_2 

♦ 

range_8a 

0.55 

He  He 

q7  total 

0.35 

adinf_8b 

0.60 

He  He 

q7a  _k 

0.37 

9|t9|C 

cstin_8c 

0.47 

He  He 

q71  o 

0.22 

usein_8d 

0.56 

He  He 

aptez_7a 

0.28 

pprtm_8e 

0.39 

He  He 

apttmTb 

0.25 

ptprm_8f 

0.55 

He  He 

trmt_7c 

0.24 

ptoop_8g 

0.60 

He  He 

verbl_7d 

0.22 

q9_total 

0.37 

HeHe  ^ 

mdchc_7e 

0.37 

delay_9a 

0.32 

He  He 

mdez_7f 

0.36 

dfclt_9b 

0.30 

HeHe 

time_7g 

0.23 

cnq)ln_10 

-0.24 

HeHe 

outcmTh 

0.19 

perfin_12 

0.58 

HeHe 

needs_7i 

0.29 

recmd_13 

0.73 

HeHe 

coord_7j 

0.46 

ql6_5 

-0.18 

HeHe 

svsat_7k 

0.32 

He  4c 

ql7_l 

0.12 

He 

mdnceTl 

0.21 

♦He 

sevl_20B 

-0.11 

He 

stfok_7m 

0.20 

He  He 

q34_l 

-0.13 

He 

mdsnt_7n 

0.20 

He  He 

q34_5 

0.16 

HeHe 

st£st_7o 

0.20 

He  He 

q35_5 

-0.13 

He 

q8  total 

0.70 

He  He 

Si^rficance  Levels :  (*)  p 

<.05,( 

**)p  <  .01,  n 

=  308 

Hypothesis  three  postulated  PPO  customer  satis&ction  was  a  function  of  one  or 
more  independent  study  variables.  Table  19  displays  the  statistically  significant,  p  <  .05, 
correlations  for  the  PPO  subsan^le  (n=308)  for  the  overall  customer  satisfaction  variable 
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and  all  other  study  variables.  Using  stepwise  regression,  these  statistically  significant 
relationships  formed  the  foundation  for  a  testable  regression  equation: 

Ha3:  Y(SATFN_1 1)  =  aoU  +  (biLOC2_l  +  b2LOC2_2  +  b3LOC2_3  + 
b4LOC2_4)  +  b5Q7_TOTAL  +  b6Q8_TOTAL  +  b7Q9_TOTAL  +  b8C]VIPLN_10  + 
b9PERFM_12  +  bioRECMD_13  +  bnSWTCH_14  +  (bi2Q16_l  +  bi3Q16_2  + 
bi4Q16_3  +  bi5Q16_4)  +  (bi6Q17_l  +  bi7Q17_2  +  b,8Q17_3  +  bi9Q17_4  + 
b2oQ17_5  +  b2iQ17_6)  +  b22SEVL_20B  +  (b23Q34_l  +  b24Q34_2  +  b25Q34_3  + 
b26Q34_4)  +  (b27Q35_2  +  b28Q35_3  +  b29Q35_4  +  b3oQ35_5  +  b3iQ34_6) 

As  done  for  the  HMO  stepwise  regression,  one  of  the  linearly  dependent  variables  of  each 
MECE  set  in  the  equation  was  manually  excluded  firomthe  stepwise  regresaon  and  roll-up 
variables  were  also  used  whenever  pos^le  and  appropriate  to  the  hypothecs  testing. 

Table  20  summarizes  the  result  of  the  MLR  for  Ha3  which  indicates  five  variables 
(willingness  to  recommend  the  plan  [RECMD_13],  plan  administration  [Q8_TOTAL], 
in^rovement  in  plan  performance  in  one  year  [PERFM_12],  management  of  care 
[Q9_TOTAL],  and  intention  to  switch  [SWTCH_14])  are  strongly  predictive  of  PPO 


TABLE  20 


INFERENTIAL  STATISTICS  FOR  H«3: 
PREDICTORS  OF  OVERALL  PPO  SATISFACTION 


Effects  Tested 

R2Full 

Model 

R2 

Restricted 

dfl 

d£2 

F-ratio 

P 

recmd_13 

.5341 

.5341 

1 

306 

350.85 

.0000 

qStotal 

.6137 

.0796 

2 

305 

242.25 

.0000 

perfin_12 

.6421 

.0284 

3 

304 

181.76 

.0000 

q9_total 

.6490 

.0069 

4 

303 

140.03 

.0000 

swtch  14 

.6539 

.0049 

5 

302 

114.14 

.0000 

Ha3:  aoU  +  birecmd_13  +  b2q8_total  +  b3perfin_12  +  b4q9_total  +  bsSwtch  M 
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overall  customer  satis&ction.  As  indicated  in  Table  20,  the  full  model  yields  an  R?  of 
.6539,  with  F(5,  302)  =  1 14. 14,  p  <  .0000.  The  unique  for  each  variable  in  the  model 
is  also  listed. 
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CHAPTER  FOUR 


DISCUSSION 

Like  other  research  studies  examining  customer  satis&ction,  many  of  this  study’s 
findings  support  previously  demonstrated  relationships.  However,  for  each  of  the 
hypotheses  postulated,  it  is  important  to  identify  not  only  the  similarities  in  findings,  but  to 
also  note  the  differences.  Lastly,  it  is  important  to  describe  the  inq)act  such  findings  have 
for  MCOs  so  that  substantive  lessons  can  be  learned  and  recommendations  can  be  made. 

Findings 
Hypothesis  One 

Prior  customer  satisfaction  studies  have  ascertained  numerous  relationships 
between  the  health  plan  option  (plan  type)  and  various  customer  satis&ction  and 
demographic  measures.  This  sanq)le  population  appears  remarkably  similar  to  those 
populations  in  the  customer  satisfaction  studies  discussed  earlier,  with  the  majority  of 
respondents  being  female,  married  consumers  who  generalfy  perceive  themselves  to  be  in 
good  health.  Contrary  to  the  literature  section  studies,  this  sanq>le  population  has 
substantially  higher  education  levels  and  has  been  enrolled  in  their  current  health  plan  for  a 
lesser  amount  of  time. 

The  results  firom  the  correlation  matrix  analysis  and  the  Student’s  t-tests  provide 
excellent  insight  into  the  key  differences  between  the  HMO  and  PPO  plan  options.  HMO 
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customers  are  more  satisfied  with  both  overall  customer  satis&ction  and  plan 
administration.  Furthermore,  HMO  customers  are  more  likely  to  believe  their  health  plan 
has  improved  over  the  last  twelve  months,  and  would  be  more  wUhng  to  recommend  the 
health  plan  to  their  femily  and  fiiends  if  they  needed  care.  Conversely,  PPO  customers  are 
more  satisfied  wMi  the  plan’s  health  care  services  and  management  of  care. 
Demographically,  HMO  customers  are  younger  than  PPO  members  and  are  more  likely  to 
be  non-caucadan. 

Areas  of  Concern 

1. )  Over  76  percent  of  respondents  reported  being  in  the  health  plan  less  than  one  year. 

As  discussed  earlier,  this  may  have  influenced  respondents’  perceptions  of  the  health 
plan  and  in:q)acted  their  response  evaluations. 

2. )  Although  the  finding  that  PPO  members  are  more  satisfied  with  their  health  care 

services  than  their  HMO  counterparts  mirrors  the  findings  firom  the  RAND  HIE  and 
the  MOS,  the  sanq>le  population  as  a  wdiole  consistently  rated  these  aiq)ects  of  care 
near  the  midpoint  (“good”)  of  the  five-point  evaluation  scale.  The  exception  to  this 
finding  was  for  variables  that  dealt  with  physician  and  staff  interactions  and 
competencies;  on  the  wfiole,  the  sanq)le  population  rated  these  aspects  of  health  care 
services  more  fiivorably. 

3. )  The  study  also  confirms  the  RAND  HIE  and  the  MOS  findings  that  HMO  members 

are  more  satisfied  with  plan  administration  and  that  PPO  members  are  more  satisfied 
with  the  management  of  care.  However,  the  sample  population  as  a  wdiole 
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consisteiitly  rated  plan  administration  below  the  midpoint  (“good”)  of  its  five-point 
evaluation  scale. 

4.)  The  majority  of  customers  are  currently  waiting  between  one  and  fourteen  days  for 
routine  care  appointments,  but  nearly  20  percent  of  the  sanq)le  is  waiting  between  15 
and  30  days  for  routine  care. 

Tniplications  for  MCOs 

These  finding  may  have  in^lications  for  MCOs  regarding  their  goals,  pohdes  and 
business  practices.  Corporate  goals  for  key  customer  service  variables  should  be 
developed  and  monitored.  Additionally,  MCOs  need  to  focus  on  developing  business 
practices  that  reduce  the  negative  inq)act  the  plan’s  administrative  pohcies  have  on  its 
customers.  Policies  and  procedures  that  facilitate  the  management  of  care  by  placing  the 
customer  at  the  correct  point-of-care,  wMe  minimizing  delays  and  difficulty,  should  be 
developed.  Suppliers  in  the  health  care  value  chain  (such  as  SETON  Human  Resources 
and  outside  contractors  for  administrative  or  health  care  services),  should  be  part  of  the 
customer  satis&ction  survey  process  and  ^ould  be  kept  abreast  of  findings.  Lastly, 
MCOs  should  keep  their  provider  network  apprised  of  the  resuhs  from  customer 
satis&ction  surveys,  particularfy  when  the  findings  for  physician  and  staff  interactions  and 
con^etencies  are  rated  &vorably. 


Hypothesis  Two 

The  HMO  population  for  this  study  was  somewhat  similar  to  the  population  of 
many  other  studies  previoudy  discussed  in  the  Uterature  section.  Survey  respondents  were 
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in  generally  very  good  health  and  well-educated.  However,  the  san^le  HMO  population 
proved  to  have  more  males  and  unmarried  respondents  than  were  rq)orted  in  the  literature 
studies. 

The  mferential  analysis  identified  nine  key  predictors  of  overall  HMO  customer 
satis&ction  accounting  for  nearly  74  percent  of  the  shared  variance.  The  regression  model 
is  represented  by  the  following  equation: 

H,2:  Y(SATFN_1 1)  =  a„U  +  biRECMD_13  +  h2Q9_TOTAL  +  b3Q7_TOTAL  + 
b4SWTCH_14  +  b5PERFM_12  +  b6CHW29_5d  +  b7BLUE_24C  +  b8CA_27D  + 
b9Q8_TOTAL 

The  nine  variables  (willingness  to  recommend,  overall  management  of  care,  overall  health 
services  satisfaction,  intention  to  switch  plans,  inqjrovement  in  plan  performance,  use  of 
chew,  feeling  downhearted  and  blue,  presence  of  cancer  and  overall  plan  administration) 
represent  critical  customer  satis&ction  measures  for  HMO  overall  customer  satis&ction. 
Contrary  to  the  findings  of  Ross,  Steward  and  Sinacore  (1995, 406),  but  supportive  of 
Ware’s  studies  (Davies  and  Ware  1991, 10),  the  behavioral  intention  questions 
(recommend  the  plan  and  intention  to  switch)  were  useful  predictors  of  HMO  overall 
satisfaction.  The  “recommendation”  question  alone  accounted  for  56  percent  of  the 
shared  variance  •v^Me  the  “switch”  question  accounted  for  only  two  percent.  In  general, 
individuals  must  have  a  comfort  level  with  thdr  health  plan  to  be  willing  to  send  their 
fiimily  and  fiiends  to  receive  care.  Given  the  consistently  lower  ratings  HMO  members 
gave  to  the  health  care  services  and  management  of  care  variables,  their  presence  in  the 
regression  equation  was  some\^hat  anticipated.  Both  of  these  variables  combined  count 


75 


for  greater  riian  1 1  percent  of  the  ^ared  variance.  Although  the  “plan  performance”  and 
‘^lan  administration”  variables  each  had  one  percent  or  less  of  the  shared  variance  for  the 
model,  they  are  important  aspects  of  care  that  can  influence  the  HMO  customer’s  overall 
satis&ction.  Lastly,  even  though  the  three  health  status  indicators  account  for  only  two 
percent  of  the  i^ared  variance  in  the  regression  model,  the  introduction  of  these  variables 
is  a  testament  to  the  value  of  collecting  health  status  mformation. 

Areas  of  Concern 

1. )  Members  of  the  HMO  population  rated  many  of  the  sub-questions  for  satisfaction 

with  health  care  services  below  the  midpoint  (“good”)  of  the  five-point  evaluation 
scale. 

2. )  Members  of  the  HMO  population  rated  overall  management  of  care  below  the  sanq)le 

mean. 

Tmplications  for  MCOs 

These  time  variables  represent  the  “critical”  aspects  of  health  care  for  HMO 
customer  satis&ction.  By  reviewing  business  practices  associated  with  these  aspects  of 
health  care  and  allocating  resources  in  conjunction  with  them,  MCOs  may  maintain  or 
inq)rove  their  levels  of  customer  satisfiiction  ratings  among  HMO  customers.  Practically 
speaking,  this  means  placing  enq)hasis  on  resources  for  member  services,  utilization 
management  and  network  development.  Additionally,  the  MCO  may  want  to  segment  its 
markets  based  on  the  HMO  findings.  Finally,  The  MCO  might  also  consider  offering 
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disease  prevention  and  maintenance  education  tailored  to  the  HMO  population’s 
demonstrated  needs  (ie.,  tobacco  cessation  courses,  cancer  siq)port  grotq)s). 

Hypothesis  Three 

This  study’s  PPO  population  was  very  similar  to  the  population  of  the  RAND  HIE 
and  the  MOS.  Respondents  were  generally  older,  more  likely  to  be  Caucasian  and  less 
healthy  than  other  study  participants.  Contrary  to  the  literature  findings,  the  PPO  sanq)le 
population  was  better  educated,  w^iich  is  probably  due  to  the  educational  requirements 
associated  with  the  health  care  industiy. 

The  inferential  analysis  identified  five  key  predictors  of  PPO  overall  customer 
satis&ction  accounting  for  65  percent  of  the  shared  variance.  The  regression  model  is 
represented  by  the  following  equation: 

Ha3:  Y(SATFN_1 1)  =  aoU  +  biRECMD_13  +  b2Q8_TOTAL  +  b3PERFM_12  + 

b4Q9_TOTAL  +  b5SWTCH_14 

The  five  variables  (willingness  to  recommend,  overall  plan  administration,  inq)rovement  in 
plan  performance,  overall  management  of  care,  intention  to  switch  plans)  represent  critical 
customer  satisfiiction  measures  for  PPO  overall  customer  satis&ction.  These  findings  also 
support  Ware’s  studies  (Davies  and  Ware  1991, 10)  tiiat  behavioral  intention  questions 
(recommend  the  plan  and  intention  to  switch)  are  useful  predictors  of  PPO  overall 
satisfaction.  For  the  PPO  population,  the  “recommendation”  question  alone  accounted  for 
53  percent  of  the  shared  variance.  The  “switch”  variable  had  nominal  effects  in  the  PPO 
model.  PPO  members  consistently  rated  plan  administration  variables  lower  than  the 
sanq)le  population;  therefore,  its  presence  m  the  regression  equation  was  expected.  The 
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lack  of  health  status  indicators  from  the  regression  equation  demonstrates  their  predictive 
efficiency  is  limited  for  the  PPO  population.  This,  however,  does  not  preclude  them  from 
being  used  for  risk-adjustment  or  segmenting  purposes. 

Areas  of  Concern 

1. )  Members  of  the  PPO  population  rated  many  of  the  sub-questions  for  satisfaction  with 

overall  plan  administration  (question  eight)  below  the  midpoint  (“good”)  of  the  five- 
point  evaluation  scale.  / 

2. )  The  lack  of  health  status  indicators  may  mean  that  additional  research  needs  to  he 

done  on  the  relationsh^  between  the  PPO  population  and  these  variables. 

Implications  for  MCOs 

These  five  variables  represent  the  “critical”  aspects  of  health  care  for  PPO 
customer  satisfiiction.  Since  all  five  of  the  PPO  predictors  are  also  found  in  the  HMO 
predictive  model,  the  ‘Triplications  for  MCOs”  outlined  in  the  section  above  should 
simuhaneously  serve  to  maintain  or  inprove  levels  of  customer  satisfaction  ratings  for 
PPO  customers.  Practically  speaking,  this  means  the  steps  the  MCO  takes  to  inprove  its 
customer  satisfrction  levels  with  HMO  customers  will  also  inprove  its  PPO  customer 
satisfrction  ratings.  However,  MCOs  will  want  to  place  a  greater  enphasis  on  all  aspects 
of  plan  administration  to  better  serve  its  PPO  customers. 

Study  T. imitations 

Depite  the  predictive  efficiencies  of  the  two  regression  models  in  the  study, 
caution  should  be  exercised  when  generalizing  tiie  results  to  the  population.  First,  the 
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gflmple  population  was  a  convenience  population  that  was  not  randomly  selected  from  all 
SHP  enroHees.  Second,  the  study  population  was  a  homogenous  groiq)  of  health  care 
workers  which  may  not  adequately  represent  the  population.  In  addition  to  these 
limitations,  die  sanqile  group  studied  uses  a  self-funded  health  care  benefit  plan,  i^iuch 
further  reduces  the  generalization  of  the  results.  The  generalization  of  study  results  should 
be  limited  to  the  study  group  and  similar  populations. 

Suggestions  for  Further  Research 

Based  on  the  limitations  of  the  current  study  and  other  factors  id^tified 
throu^out  the  project,  further  research  should  be  conducted  to  build  on  the  findings  from 
this  baseline  study.  First,  continued  studies  using  SETON  network  enqiloyees  should  be 
conducted.  Such  studies  may  he^  eliminate  the  effects  their  limited  time  in  the  health  plan 
might  have  had  on  evaluation  response.  Furthermore,  the  studies  might  also  validate  the 
use  of  variables  eliminated  from  this  study.  Continued  studies  should  also  help  identify 
trends  in  the  SETON  population  and  provide  a  mechanism  to  update  and  continually 
explain  predictors  of  customer  satisfaction.  As  the  SHP  enroUee  base  grows  to  include 
other  lines  of  business  (e.g.,  fully-insured  products,  worker’s  conq>ensation  managed  care. 
Medicare-risk),  the  studies  should  be  expanded  to  include  these  populations.  Doing  so 
should  help  make  study  results  more  generalizable  across  muh^le  populations.  Second, 
the  addition  of  a  ranking  mechanism  that  allow  customers  to  rank  or  identify  aspects  of 
care  that  would  most  likely  increase  their  satisfiiction  should  also  be  conddered  for  further 
study.  This  notion  has  been  identified  as  critical  to  the  use  of  customer  satisfrction  data 
for  quality  assurance  and  in^rovement  programs  in  the  health  care  setting  by  Scott  and 
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Smith  (1994,  355).  Their  position  is  that  without  customers’  ranking  the  in^ortance  of 
various  constructs  for  improvement  opportunities,  health  care  organizations  may 
inadvertentfy  waste  precious  resources  on  in5)roving  services  that  customers  do  not  prefer 
to  be  inqiroved.  As  such,  these  researchers  believe  that  customer  satis&ction  or 
dissatis&ction  with  a  particular  construct,  variable  or  domain  does  not  necessarily  warrant 
quality  iD:q}rovement  efforts  unless  that  issue  has  been  identified  as  mq)ortant  to 
customers.  Third,  the  addition  of  smaller,  site  specific  surveys  (e.g.,  GHAA’s  vi^- 
specific  questionnaire,  AHCPR’s  child  health,  hoq)ital  and  mental  health  surveys)  should 
also  be  considered  for  future  study.  Since  no  one  survey  can  capture  all  aspects  of  care 
across  the  continuum,  the  addition  of  ^e-specific  surveys  may  be  the  optimal  method  for 
measuring  customer  satisfaction  across  muh^le  delivery  ^sterns  and  sites  of  care. 

Fourth,  and  finally,  additional  research  needs  to  be  conducted  on  the  cost  effectiveness  of 
irtq)lementing  a  customer  satisfiiction  survey.  Research  that  ties  inq)rovements  or 
degradations  in  customer  satis&ction  to  an  MCO’s  bottom-line  financial  performance  is 
paramount  to  long-term  organizational  viability. 
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CHAPTER  FIVE 


RECOMMENDATIONS 

While  the  data  collection  process  and  the  outcome  of  the  study  have  inq)ortant 
research  applications,  the  study’s  main  objective  is  to  develop  a  senes  of  recommendations 
for  the  management  of  both  the  Seton  Health  Plan  and  the  Military  Health  Service  System 
Although  the  implications  for  MCOs  outlined  in  the  ‘THscussaon”  section  provide  broad 
observations  on  uses  for  customer  satisfaction  survey  results  in  managed  health  care,  these 
rftcnmmenHatinns  are  Specific  to  the  future  deployment  of  this  survey  and  to  these 
organizations’  ongoing  efforts  to  continuously  measure  and  in:q)rove  their  levels  of 
customer  satisfaction. 


Seton  Health  Plan  Recommendations 

1.)  The  1995  Annual  Member  Health  Care  Survey  Manual,  Version  1. 0  is  an 

appropriate  and  valid  survey  instrument  tool  for  the  Seton  Health  Plan  to  use  to 
measure  customer  satisfaction. 

The  implementation,  hypothesis  testing  and  results  from  this  study  validate  the  use 
of  this  survey  instrument  (with  the  questions  added  by  the  SETON  network)  as  beneficial 
for  the  Seton  Health  Plan.  The  instrument  successfully  measured  a  battery  of  customer 
satisfaction  variables  encoiopassing  a  variety  ofiaq)ortant  aspects  of  health  care  services 
and  demographic  attributes  and  health  status  indicators.  The  survey  instrument  yielded 
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statistically  significant  predictors  of  customer  satisfaction  between  and  within  the  HMO 
and  PPO  product  lines.  Uhimately,  v^Me  it  might  be  fine-tuned  to  in[q)rove  ease-of-use, 
the  survey  is  a  robust  and  reliable  means  of  measuring  customer  satis&ction  fi)r  the 
SETON  network. 

2.)  Continue  to  administer  the  survey  on  an  annual  basis  using  the  methods  and 
procedures  outlined  in  this  project. 

As  outlined  in  the  “Suggestions  for  Further  Research”  section  of  the  paper, 
continued  studies  using  SETON  network  «iq)loyees  should  be  conducted  on  an  annual 
basis  to  monitor  trends  in  customer  satisfiiction.  bi  the  “Methods  and  Procedures”  section 
of  this  study,  it  was  demonstrated  over  33  percent  of  all  HMO  customers  and  60  percent 
of  all  PPO  customers  were  included  in  the  initial  mail-out.  If  the  survey  is  administered 
more  than  once  per  year,  it  will  only  serve  to  saturate  the  customer  group  and  will 
probably  decrease  re^onse  rates.  Although  the  methods  and  procedures  used  in  this 
study  deviated  modestty  fi*omthe  NCQA’s  protocol,  the  respondent  incentives  included 
and  processes  used  yielded  a  well-above  normal  response  rate  for  mail  surveys  (44 
percent).  Additionally,  it  is  inqiortant  to  note  that  the  questions  added  by  the  SETON 
network  for  exercise  (questions  29[3b  and  4])  should  be  reworded  and  re-tested  with 
future  iterations  of  the  survey.  Furthermore,  the  questions  regarding  the  use  of  out-of¬ 
network  services  and  waiting  times  for  different  care  levels  (questions  5  and  15) 
eliminated  j&om  this  study  should  be  included  and  tested  again  in  the  next  study.  As  the 
number  of  enrolled  lives  or  lines  of  buaness  grow  for  the  Seton  Health  Plan,  the  survey 
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administration  methods  and  procedures  should  be  reviewed  and  altered  as  needed  to 
support  corporate  goals  and  objectives. 

3. )  Develop  a  “Mini-SHP  Survey”  to  conduct  customer  satisfaction  “Pulse 

Checks” (e.g.,  quarterly). 

Using  the  five  predictive  variables  that  are  common  to  both  the  HMO  and  PPO  regression 
models  developed  in  this  study  and  the  10-question  disenroUment  survey  firom  the  Weiss 
and  Senf  study  (1986, 445),  a  “mini-survey”  should  be  created  that  predicts  both  customer 
satisfaction  and  the  likelihood  of  disenroUment.  This  survey  could  be  distributed  through 
a  variety  of  informal  and  formal  mechanisms  (i.e.,  member  newsletters,  open  enroUment 
periods,  enq)loyer  mail-outs)  on  a  more  frequent  basis  as  a  “pulse  check”  for  ongoing 
customer  satisfaction  within  the  network.  Once  the  information  was  received  and 
analyzed,  marketing  efforts  could  be  focused  on  improving  customer  satisfaction  and 
preventing  disenroUment. 

4. )  Use  the  results  to  support  Seton  Health  Plan ’s  purchasing  decisions. 

Since  the  survey  instrument  has  specific  questions  relating  to  satisfection  with 
health  care  providers,  the  responses  from  these  questions  can  be  extrapolated  firom  the 
survey  and  used  to  measure  satis&ction  with  the  provider  network.  In  turn,  Seton  Health 
Plan  can  provide  the  information  to  physician  and  extender  members,  and  work  with  them, 
via  the  SHP  QuaUty  Inq)rovement  Committee,  to  determine  realistic  customer  satis&ction 
goals  for  the  network.  Once  this  process  is  in  place,  fiiture  decisions  on  provider  inclusion 
and  exclusion  from  the  network  should  include  customer  satisfiiction  measurements. 
AdditionaUy,  the  results  of  the  customer  satisfrction  survey  can  be  used  to  evaluate  the 
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performance  of  SHP’s  outsourced  contractors.  All  members  of  the  SHP  network  for  the 
delivery  of  care  and  administrative  services  ^ould  be  ejqtected  to  meet  acceptable 
customer  satis&ction  standards  that  are  stipulated  as  part  of  the  contractual  arrangement. 
In  doing  so,  the  SHP  ^otild  reap  two  benefits:  increased  levels  of  customer  satisfection 

with  network  providers  and  services  and  incproved  working  relations  with  the  network’s 

I 

I 

I 

suppliers. 

5. )  Use  the  results  as  part  of  the  SHP  Quality  Improvement  Program  (QIP). 

Even  though  the  SHP’s  QIP  is  in  its  beginning  stages,  the  results  fi-om  this  survey 

I 

should  be  documented  and  additional  surveys  should  be  conducted  to  trend  the  results. 
Furthermore,  the  results  should  be  used  in  the  annual  work  plan  review  to  in:q)roye  the 
upcoming  year’s  quality  improvement  plan.  The  customer  satis&ction  survey  is  one 
onmpnnent  of  the  SHP  QIP,  and  is  intended  to  work  with  all  other  surveys  and  studies 
done  to  improve  the  delivery  of  care  and  its  enroUees’  health  status.  Preseotfy,  the  SHP 
has  less  than  one  fiiU-time  equivalent  (FTE)  dedicated  to  the  program.  Without  the 
addition  of  one  FTE  (analyst)  that  has  conq)lete  req)onsibility  for  the  QIP,  the  SHP  will 
have  a  difficult  time  in^lementing  the  QIP  to  its  fiiUest  potential,  meeting  the  NCQA’s 
stringent  accreditation  standards,  and  ultimately,  inq)roving  their  levels  of  customer 
satisfitction. 

6. )  Use  the  results  for  accreditation  purposes. 

Accreditation  is  rapidly  becommg  a  discriminator  for  en:q)loyers  when  they  make 
their  decisions  regarding  t^ch  health  plan(s)  to  contract  with  for  their  health  benefits. 
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Although  the  practice  is  commoiily  found  among  enq)loyers  that  provide  health  benefits 
for  a  larger  number  of  enqjloyees,  the  standard  is  slowly  ebbing  into  smaller  en^loyer 
groups,  many  of  v^bich  have  self-fimded  health  programs.  As  the  demand  for 
accredhation  grows  both  in  the  fiiUy-insured  and  self-insured  markets,  SHP  will  need  to 
seek  accredhation  from  NCQA  or  hs  equivalent.  When  the  SHP  decides  to  pursue 
accredhation,  evidence  of  ongoing  customer  satisfrction  surveys  and  use  of  the  resuhs  to 
improve  the  health  plan  will  be  an  essential  conq>onent  for  receiving  accredhation.  This 
survey  provides  a  baseline  analysis  and  mechanism  for  meeting  this  accredhation  standard. 

7. )  Use  the  survey  results  for  internal  strategic  planning  and  resourcing  efforts. 

The  survey  resuhs  should  play  an  inqrortant  role  in  SHP’s  ongoing  strategic 
planning  and  resourcing  efforts.  Fhst  and  foremost,  the  survey  resuhs  should  be  used  in 
developing  SHP’s  corporate  fiscal  year  goals  and  objectives  for  customer  satisfaction. 
Second,  and  an  extension  of  the  first,  SHP  enqiloyees’  bonuses  should  be  tied  to  meeting 
or  exceeding  the  established  goals  and  objectives  for  customer  satisfaction.  The  creation 
of  concrete,  achievable  goals  that  enqiloyees  may  affect  through  daily  customer 
interactions  can  have  a  profound  and  lasting  inqiact  on  both  the  customers’  and 
enqiloyees’  satisfection  with  the  health  plan.  Lastly,  the  five  key  predictors  from  both  the 
HMO  and  PPO  regression  equations  clearly  indicate  that  member  services,  utilization 
management  and  network  development  and  maintenance  are  the  departments  with  the 
greatest  impact  on  customer  satisfiiction.  As  such,  any  strategic  planning  should  reinforce 
and/or  eiqiand  the  resources  and  capabilities  of  these  fimctions. 
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8. )  The  survey  results  can  be  used  for  multiple  marketing  purposes. 

Presently,  although  the  SHP  has  a  general  marketing  strategy  and  target  markets, 
the  marketing  plan  itself  is  in  a  rudimentary  stage.  The  results  of  the  study  should  be  used 
for  the  development  of  SHP’s  final  marketing  plan,  hi  particular,  the  health  status  and 
demographics  section  of  the  survey  can  be  used  to  tailor  the  marketing  plan  by  the  current 
market  segments.  Additionally,  the  study  results  can  be  used  to  support  the  product 
design  and  development  fimctions.  As  an  example,  SHP  is  currently  targeting  self-fimded 
en5)loyers  in  the  Austin  market.  Since  the  SETON  population,  the  subject  of  the  survey, 
is  also  self-fimded,  population  attributes  and  disease  incidence  may  provide  valuable 
information  for  developing  the  pricing  structure  and  other  marketing  efforts  for  this 
particular  product.  Finally,  as  SHP  develops  the  promotional  and  advertisement  items  for 
their  various  products,  the  survey  results  can  be  used  to  target  customers  and  focus 
attention  on  excellence  in  the  key  areas  vshich  have  been  identified  as  critical  for 
customers’  perceptions. 

9. )  Distribute  the  survey  results  to  customers  and  suppliers  in  Seton  Health  Plan ’s 

health  care  value  chain. 

The  benefits  of  distributing  the  information  to  customers  and  suppliers  in  the  value 
nhaiti  cannot  be  underestimated.  External  suppliers  of  services  (e.g.,  health  care  fiidlities, 
physicians,  outsourced  contractors)  for  SHP  customers  should  receive  the  customer 
satisfoction  survey  results  so  that  they  can  use  it  for  internal  process  ur^jrovement.  hi 
addition,  internal  suppliers  of  services  (e.g.,  SHP  departments)  should  also  be  given  the 
information  for  internal  process  inqirovement.  This  information  can  be  used  by  these 
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departments  to  develop  customized  plans  and  programs  based  on  population 
characteristics  and  needs.  In  addition  to  distributing  the  results  to  suppliers,  the  results 
should  be  communicated  to  SETON  network  employees  through  both  mformal  (e.g., 
ftmpinyee  pay  Stubs,  SETON  network  e-mail)  and  formal  (e.g.,  SETON  Heartbeat 
newsletter,  department  meetings,  SETON  Q  &  A)  mechanisms.  The  information 
communicated  to  SETON  en^loyees  should  address  the  broad  results  from  the  survey  and 
the  steps  the  SKDP  is  taking  to  meet  and  exceed  their  health  care  needs  and  eiqiectations. 
Furthermore,  the  information  ^ould  educate  employees  on  processes  or  steps  they  can 
take  to  improve  their  own  interaction  with  the  health  plan  and  delivery  system,  and  how 
this  benefits  them  as  health  care  consumers.  Lastly,  the  information  passed  to  the 
employees  should  hel^  them  to  understand  how  SETON  leadersh^  is  addressing  their 
concerns  with  their  health  care  delivery.  Once  these  steps  have  been  taken,  SETON 
Human  Resources  can  directly  measure  the  inqiact  on  enqiloyee  morale  and  retention 
through  their  enqiloyee  survey  process. 

Military  Health  Service  System  Recommendations 
Like  our  civilian  counterparts,  the  Military  Health  Service  System  (MHSS)  needs 
to  use  the  results  of  customer  satisfrction  surveys.  As  the  MHSS  makes  the  transition 
from  a  hospital-centered  to  a  managed  care  system,  customer  satis&ction  results  will  be 
one  of  the  primary  methods  for  evaluating  the  TRICARE  support  contracts.  Furthermore, 
customer  satis&ction  surveys  will  be  key  mechanisms  for  tracking  the  needs  and  health 
status  of  our  population  and  determining  if  the  MHSS  has  effectively  and  efficiently  met 
these  ever-changiag  needs  in  the  long  term. 
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Many  of  the  recommendations  for  the  SHP  can  also  be  generally  applied  to  the 
MHSS  Lead  Agents  if  a  survey  process  is  already  in  place.  However,  one  of  the  greatest 
challenges  feeing  the  Lead  Agents  is  a  very  fragmented  and  largely  unusable  customer 
satisfection  survey  process.  Ahhou^  great  strides  have  been  taken  to  improve  the 
customer  satisfection  survey  process  within  each  military  service,  the  MCS  contractors 
have  not  yet  been  mandated  to  use  a  common  survey  instrument  as  part  of  then- 
requirement  to  measure  and  report  customer  satisfection.  As  such,  the  data  eventually 
received  from  the  MCS  contractors  will  not  be  standardized,  making  comparisons  between 
the  regions  virtually  useless.  The  results  from  this  project  may  provide  meaningful 
information  for  improving  the  TRICARE  customer  satisfection  survey  process  and  results. 
Therefore,  the  following  recommendations  are  made: 

1. )  Pass  all  the  materials  from  this  study  to  HQ  USAF/SGR,  Survey  Coordinator ,  for 

consideration  and  use  in  the  development  of  a  standardized  survey  for  regional  MCS 
contractors. 

2. )  Work  with  the  Survey  Coordinator  to  determine  the  applicability  of  these  findings  to 

current  Air  Force  andDoD  efforts  to  standardize  and  improve  the  quality  of 
customer  satisfaction  surveys. 

Despite  the  use  of  these  results  for  Air  Force  or  DoD  purposes,  the  ongoing 
efforts  by  each  service  and  the  DoD  to  develop  and  inqilement  a  standardized  customer 
satisfection  survey  for  the  MCS  contractors  is  admirable.  Not  only  does  it  strengthen  the 
partnership  between  the  military  and  civilian  components  of  the  TRICARE  delivery 
system,  but  it  will  also  create  a  system  for  conqiaring  results  between  regions  and  MTFs. 
In  the  end,  once  the  data  has  been  collected  and  analyzed,  the  MHSS  can  learn  from  the 
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regions  that  are  best  meeting  and  exceeding  customer  needs,  thereby  in^roving  customer 
satis&ction  for  all  DoD  beneficiaries. 
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6.  Overall  satis&ction  at  baseline  is  not  predictive  at 
follow-up. 
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may  positively  impact  the  percepticm  on  the  Q(X1.  The 
reverse  relationship  existed  althou^  it  was  not  strong 
and  it  was  negative. 

4.  The  strength  of  the  combined  model  was  less  than  that 
of  each  separate  model  on  influencing  overall  satis&ction. 
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3.  The  two  most  predictive  questions  included  “intention 
to  switch”  and  “happiness  with  coverage  of  the  present 
medical  plan”  questions.  ,  _ 
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SAMPLING  AND  DATA  COLLECTION  PROTOCOL  FOR  THE 
ANNUAL  MEMBER  HEALTH  CARE  SURVEY 


Responsibilities 

The  reliability,  confidentiality  and  con^arabihty  of  all  plans'  data  are  priorities.  To  ensure 
these  objectives  are  met,  the  responsibility  for  sanq)ling,  as  well  as  data  collection  and 
processing  lies  with  the  research  firm. 

The  protocols  outlined  herein  identify  the  steps  to  be  taken  for  san^ling,  data  collection 
and  processing. 

Sample  Universe 

To  have  the  opportunity  to  be  sent  a  questionnaire,  the  sanqrling  universe  (population)  will 
be  comprised  of  the  total  enrolled  membership.  During  this  inq)lementation/evaluation 
period  of  the  Annual  Members  Health  Care  Survey,  a  12-month  time  period  ^ould  be 
selected  during  \^ch  enrollees  were  continuously  enrolled  allowing  for  multiple  breaks, 
each  up  to  45  days  in  length. 

Data  Ffle  Elements 

The  following  data  file  elements  on  the  entire  enrolled  membersh^  must  be  provided  by 
each  plan,  for  each  product  type  to  be  evaluated,  in  order  for  the  sanq)le  to  be  pulled  by 
the  research  firm 

•  Member  Identification  Number:  Used  as  a  quality  control  check  to  ensure  each 
member  is  only  identified  once  in  the  sanq)le  tape. 

•  Member  First  Name:  Used  for  addressing  cover  letter  and  mailing  piece. 

•  Member  Middle  Initial:  Used  for  addresi^g  cover  letter  and  mailing  piece. 

•  Member  Last  Name:  Used  for  addressing  cover  letter  and  mailing  piece. 

•  Member  Gender:  Used  for  addressing  cover  letter  and  mailing  piece  as  well  as 
referencing  monbers  18  years  of  age  or  under  (e.g.,  "your  son . . .  "). 

•  Member  Date  of  Birth:  Identifies  member  1 8  years  of  age  or  under.  Questionnaires 
are  sent  to  subscriber/parent  or  guardian. 

•  Member  Date  of  Enrollment:  Used  for  analysis  and  reporting,  e.g.  new  enrollees  vs. 
long  term  members. 

•  Member  Street  Address:  Mailing  piece. 

•  Member  Cify:  Mailing  piece. 
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•  Member  State:  Mailing  piece. 

•  Member  Zip  Code:  Mailing  piece. 

•  Name  of  Plan:  Used  to  identify  plan  in  cover  letter  and  questionnaire. 

•  Member  Identifier  (Commercial,  Medicare,  Medicaid):  Will  be  used  in  estimating 
non-deliverables  and  reporting. 

Sampling 

The  research  firm  must  assign  a  random  number  to  each  member  in  eligible  population  and 
then  sort  the  eligible  population  in  ascending  order.  The  necessary  sanq>le  size  is  selected 
firom  the  top  of  the  sort. 

Assuming  a  7  percent*  non-deliverable  rate,  a  sanq)le  of 825  will  be  pulled  to  achieve  a 
return  sanq)le  of 384  (assumes  a  probability  of  the  characteristics  at  50  percent  for  a  95 
percent  confidence  interval  with  a  margin  of  +/-  5  percent).  Plans  are  allowed  to  draw  a 
larger  sanq)le  but  must  adhere  to  the  minimum  rehouse  rate  of  50  percent,  bi  addition,  a 
separate  sanq)le  should  be  drawn  for  each  product  to  be  evaluated  (e.g.,  HMO,  POS, 
PPO),  with  resuhs  reported  separately. 

(*Note:  The  non-deliverable  rate  should  be  adjusted  based  on  the  mix  of  plan  types,  e.g. 
high  Medicaid  enrollees.) 

Creating  the  Mailing  Piece 

In  order  to  ensure  the  highest  response  rate,  and  ultimately  the  most  reliable  data,  the 
following  procedures  will  be  followed: 

Address  Standardization:  To  increase  the  deliverability  of  the  mailing  piece,  each 
selected  member's  address  should  be  processed  through  the  U.S.  Postal  Service  CASS 
Certified  Z^+4  Coding  Software. 

First  class  postage:  First  class  postage  and  postal  bar  coding  should  be  used  on  all 
outgoing  mail  pieces. 

Mailing  Piece  Content:  The  questionnaire  will  be  mailed  to  a  specific  member,  as 
opposed  to  "subscriber"  or  "occupant."  Personalization  of  the  survey  should  include  the 
following: 

•  Member  name,  used  in  cover  letter. 

•  Plan  name  in  cover  letter  and  in  questionnaire  where  noted. 
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•  Plan  logo,  used  in  cover  letter  as  well  as  questionnaire. 

•  Signature  from  plan  CEO  or  Medical  Director,  increases  legitimacy  of  study. 

•  Research  firm's  toU-firee  phone  number  for  questions/clarification.  The  line  ^ould  be 
staffed  24  hours  in-person  or  electronically. 

•  If  available,  questionnaires  should  be  printed  in  the  preferred  language  of  the  member. 
If  not  available,  instructions  should  be  printed  on  the  questionnaire  for  the  languages 
that  represent  5  percent  or  greater  of  consumers  in  plan's  service  area.  If  the  member's 
preferred  language  is  known,  this  information  should  be  used. 


Cover  letter:  The  cover  letter  is  included  in  the  mailing  piece  and  should  include 
plan  logo,  CEO  signature,  and  addressed  as  noted  above. 

Envelopes:  The  mailing  piece  will  include  the  questionnaire,  with  the  cover  letter, 
a  windowed  enveloped  and  an  addressed,  business  reply  envelope  to  the  research  firm. 

Mailing  Procedures 

Data  collection  will  be  completed  as  follows: 

1.  Initial  questioimaire  mailing. 

2.  Reminder  postcard  mailed  to  all  non-respondents  two  weeks  after  the  first 
questioimaire. 

3.  Replacement  questioimaire  mailed  to  all  non-respondents  fisur  weeks  after 
the  first  mailing. 

4.  Data  collection  should  be  cut  off  two  weeks  after  the  mailing  of  the  second 
survey  mailing  (Step  #3). 

In  order  for  the  data  to  be  conadered  statistically  precise,  the  following  must  be 
acconpUshed: 

1.  A  mmimum  50  percent  reponse  rate, 

2.  A  total  of  384  conpleted  surveys.  For  plans  receiving  more  than  384 
surveys,  384  should  be  randomly  selected  using  the  protocols  outlined  in  the  sanpling 
guidelines. 

Replacement  Surveys 

Replacement  surveys  (lost,  misplaced,  language,  etc.)  will  follow  the  same  steps  as  noted 
above. 
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SAMPLE  MAIL  PIECES 
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# 

SETOH 


1201  WEST  38TH  STREET 
AUSTIN,  TEXAS  78705-1056 
(512)  323-1900 
(512)  459-5629  FAX 
seton@goodhealth.com 


February  1,  1996 

«Salutation»  «First_Name»  «Last_Name» 
4cSTREET> 

«CITY^  4cSTATE)^  ^Zip_Code)^ 


SETON  MEDICAL  CENTER 
1512)  323-1000 


BRACKENRIDGE  HOSPITAL 
(512)  476-6461 


SETON  NORTHWEST  HOSPITAL 
(512  )  795-1000 


CHILDREN'S  HOSPITAL 
(512)  480-WS 


SETON  EAST  COMMUNITY 
HEALTH  CENTER 
(512)  385-4114 


SETON  SOUTH  COMMUNITY 
HEALTH  CENTER 
(512)  440-1650 


SETON  SOUTHWEST  MINOR 
EMERGENCY  CE.NTER 
(522)  326-2243 


SETON  HOME  CARE 
(512)  323-mO 


SETON  PHYSICIAN 
HOSPITAL  NETWORK 
(522)  323-1929 


SETON  FUND 
(512)  325-1990 


CHILDREN'S  HOSPITAL 
FOUNDATION  OF  AUSTIN 
(512)  480-1243 


SETON  HEALTH  PLAN 
(522)  323-2953 


Dear  «Salutation»  «Last_Name», 

This  is  one  dollar  of  your  health  benefits!  I’m  returning  it  to  you  so  that 
you  can  make  a  difference  in  the  future  health  benefits  and  services  oifered  to 
SETON  network  employees  and  their  families.  In  our  efforts  to  continuously 
address  and  improve  the  health  benefits  and  services  offered  to  our  employees,  the 
Seton  Health  Plan  is  conducting  a  customer  satisfaction  survey.  The  results  from 
this  survey  will  play  an  important  role  in  shaping  future  benefits  and  services. 

The  survey  provides  a  comprehensive  list  of  questions  regarding  SETON 
network’s  health  benefits  and  services.  It  takes  approximately  15  -  20  minutes  to 
complete.  Please  read  the  questions  carefully  and  thoughtfully  answer  each 
question.  Once  you’ve  completed  the  survey,  please  place  it  in  the  return 
envelope  and  mail  the  survey. 

Completing  the  survey  also  provides  you  with  the  opportunity  to  enter  our 
survey-related  drawing.  One  survey  respondent  will  receive  two  free  months  of 
healthcare  premiums  courtesy  of  the  Seton  Health  Plan.  So  please,  take  the  time 
to  fill-out  and  send,  “THE  SETON  TWO  FREE  MONTHS  OF  HEALTHCARE 
PREMIUMS  POSTCARD”  that’s  been  included  in  your  survey  package. 

Your  feedback  is  important  in  shaping  SETON’s  healthcare  benefits  and 
services.  Please  take  this  opportunity  to  make  the  value  of  the  dollar  below  more 
meaningful  to  SETON  employees  and  their  families. 


Thank  you  for  your  time  and  survey  submission. 


We  serve  mch  person  as 
a  Christian  would  serve 
Christ  Himself. 


CHARLES  J.  BARNETT 
President  &  CEO 


Daughters  of  Charity 

HEALTH  SERVKES  Of  AUSTIN 


DAUGHTERS 

OF 

CHARTTY 


MAno*iALM£AtiH  rrvmu 
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ANNUAL  MEMBER  HEALTH  CARE  SURVEY 
Adult  Survey 


ABOUT  TfflS  SURVEY 

This  survey  asks  you  to  rate  the  health  plan  in  which  you  are  currently  enrolled.  Our  records 
show  that  you  are  a  member  of  Seton  Health  Plan. 

The  results  of  this  survey  will  be  used  to  help  people  like  you  learn  more  about  your  current 
health  plan  when  evaluating  what  plan  to  choose.  People  in  other  health  plans  will  complete  the 
same  survey.  So,  you  and  others  will  be  able  to  compare  your  plan  with  other  plans  the  next  time 
you  get  to  choose  a  plan.  These  results  will  also  help  purchasers,  such  as  employers,  understand 
how  well  the  health  plans  they  offer  are  performing  and  give  feedback  to  the  plans  in  order  to 
improve  their  services. 

All  of  your  responses  are  strictly  confidential.  All  of  your  responses  will  be  combined  with  those 
of  other  members  who  respond  to  the  survey. 

Please  return  your  completed  survey  in  the  enclosed  stamped  and  addressed  envelope  as  soon  as 
possible. 
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HEALTH  PLAN  ENROLLMENT  INFORMATION 

The  following  items  ask  about  the  Seton  Health  Plan, 

Please  circle  the  number  next  to  your  answer. 

1.  Our  records  indicate  that  you  are  covered  by  the  Seton  Health  Plan,  Is  this  true? 

1.  Yes 

2.  No  If  no,  please  return  this  survey  in  the  envelope  provided. 


2.  How  long  have  you  been  covered  by  this  health  plan? 

1 .  Less  than  6  months 

2.  At  least  6  months,  but  less  than  1  year 

3.  At  least  1  year,  but  less  than  2  years 

4.  At  least  2  years,  but  less  than  5  years 

5.  5  years  or  more 


3.  Did  you  enroll  during  your  company's  open  enrollment  period?  (This  is  the  period  of  time  in 
which  your  company  allows  you  to  select  your  health  plan). 

1.  Yes 

2.  No  If  no,  please  write  the  name  of  the  month  you  enrolled  _ 

Please  answer  these  questions  for  the  length  of  time  you  have  been  covered  by  the  Seton  Health 
Plan.  Answer  questions  with  only  the  Seton  Health  Plan  in  mind. 
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HEALTH  SERVICES 


This  set  of  questions  asks  about  health  services  ynii  have  received,  such  as  overnight  hospital 
care  or  care  from  your  physician  and  other  health  care  professionals,  such  as  a  nurse 
practitioner,  midwife,  physician's  assistant  or  registered  nurse. 


4.  Please  estimate  the  total  number  of  visits  you  have  had  for  the  following  health  care  services  in 
the  past  12  months. 


(Circle  one  number  on  each  line ) 


a.  Visits  to  a  doctor  or  other  health  care 
professional  for  any  illness,  injury,  or 
preventive  care  to  help  you  stay  well 

None 

1-4 

5-9 

10+ 

b.  Overnight  hospital  stays  (count  each 
entire  stay  as  1) 

None 

1-4 

5-9 

10+ 

If  you  answered  "NONE"  to  BOTH  questions,  go  to  Question  if  7  on  page  3  of  the  survey. 


5.  Were  any  of  these  services  NOT  received  through  the  Seton  Health  Plan? 

_ (Circle  all  that  apply) 


a.  Visits  to  a  doctor  or  other  health  care  professional  for  any 
illness,  injury,  or  preventive  care  to  help  you  stay  well 

Yes 

No 

b.  Overnight  hospital  stays 

Yes 

No 

If  you  answered  "NO"  to  BOTH  questions,  go  to  Question  #  7  on  page  3  of  the  survey. 


6.  If  you  did  not  receive  services  through  the  Seton  Health  Plan,  please  tell  us  why. 

(Circle  all  that  apply) 


Cost  was  less  outside  Seton  Health  Plan  1 

Service  or  care  was  not  available 

at  Seton  Health  Plan  2 

Preferred  another  doctor  or  wanted  a  second  opinion  3 

Seton  Health  Plan  did  not  approve  care  4 

Physical  problems  made  it  difficult  for  you 

to  get  to  the  office  or  clinic  5 
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7.  HEALTH  CARE 


a.  Ease  of  making  appointments  for  medical 
care  by  phone 


b.  Length  of  time  you  wait  between  making 
an  appointment  for  routine  care  and  the  day 
of  your  visit 


c.  Thoroughness  of  treatment 


d.  Attention  given  to  what  you  have  to  say 


e.  Number  of  doctors  you  have  to  choose 
from 


f.  Ease  of  choosing  a  personal  physician 


g.  Amount  of  time  you  have  with  doctors  and 
staff  during  a  visit 


h.  The  outcomes  of  your  medical  care,  how 
much  you  are  helped 


i.  How  well  your  care  meets  your  needs 


j.  How  well  the  whole  system  works  together 
to  coordinate  your  medical  care,  including 
how  weU  different  people  and  departments 
communicate  with  you  and  with  each  other 
about  your  care 


k.  Overall  quality  of  care  and  service 


1.  Courtesy  of  your  primary  physician 


m.  Courtesy  of  your  primary  physician's  staff 
members 


n.  Your  primary  physician's  sensitivity  to  your 
needs 


0.  Your  primary  physician's  staffs*  sensitivity 
to  your  needs 


POOR 

FAIR 

GOOD 

1 

2 

3 

1 

2 

3 

1 

2 

3 

1 

2 

3 

1 

2 

3 

1 

2 

3 

1 

2 

3 

1 

2 

3 

1 

2 

3 

1 

2 

3 

1 

2 

3 

1 

2 

3 

1 

2 

3 

1 

2 

3 

1 

2 

3 

(Circle  one  number  on  each  line) 


VERY 

GOOD 
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8.  PLAN  ADMINISTRATION 


(Circle  one  number  on  each  line) 


POOR 

FAIR 

GOOD 

VERY 

GOOD 

EXCELLENT 

a.  Range  of  services  covered  by  your  plan 

1 

2 

3 

4 

5 

b.  Availability  of  information  from  your  plan 
about  eligibility,  covered  services,  or 
administrative  issues 

1 

2 

3 

4 

5 

c.  Availability  of  information  from  your 
doctor  or  plan  about  costs  of  care 

1 

2 

3 

4 

5 

d.  Of  the  information  received,  the  material  is 
clear  and  easy  to  use 

1 

2 

3 

4 

5 

e.  Length  of  time  you  spend  filling  out  claim 
fonns  or  other  paperwork 

1 

2 

3 

4 

5 

f.  The  part  of  the  premium  YOU  pay  for 
covered  services 

1 

2 

3 

4 

5 

g.  Amount  YOU  pay  out-of-pocket  (for 
example:  co-payments,  deductibles, 
payments  for  services  not  covered) 

1 

2 

3 

4 

5 

9.  MANAGEMENT  OF  CARE 

Have  any  of  the  following  been  a  problem  for  you  in  arranging  your  medical  care?  If  so,  how 
much  of  a  problem? 


(Circle  one  number  on  each  line) 


: . T'  • 

;  ■  •  'L  . 

YES,  A 

BIG  PROBLEM 

YES,  A 

SMALL  PROBLEM 

NO,  NOT 

A  PROBLEM 

a.  Delays  in  your  medical  care  while  you  wait 
for  approval  by  your  health  plan 

1 

2 

3 

b.  Difficulty  in  receiving  care  you  and  your 
doctor  believe  is  necessary 

1 

2 

3 

c.  Not  being  able  to  get  a  referral  to  a  specialist 
that  you  want  to  see 

1 

2 

3 
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10.  Have  you  called  or  written  the  Seton  Health  Plan  with  a  complaint  or  problem  in  the  last  12 
months? 


Yes 

No 


(Circle  one) 

1 

2  (go  to  question  11) 


How  long  did  it  take  for  the  health  plan  to  resolve  your  complaint? 

(Circle  one) 


Same  day  1 

1  week  2 

2  weeks  3 

3  weeks  4 

4  or  more  weeks  5 

Not  yet  resolved  6 


11.  All  things  considered,  how  satisfied  are  you  with  your  current  health  plan? 

(Circle  one) 


Completely  satisfied,  couldn't  be  better  1 

Very  satisfied  2 

Somewhat  satisfied  3 

Neither  satisfied  nor  dissatisfied  4 

Somewhat  dissatisfied  5 

Very  dissatisfied  6 

Completely  dissatisfied,  couldn't  be  worse  7 


12.  During  the  past  12  months,  did  your  plan's  overall  performance  get  better,  stay  the  same,  or  get 
worse? 

(Circle  one) 


Much  better  1 

Somewhat  better  2 

Stayed  the  same  3 

Somewhat  worse  4 

Much  worse  5 
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13.  Would  you  recommend  your  current  health  plan  to  your  family  or  friends  if  they  needed  care? 

(Circle  one) 

Definitely  yes  1 

Probably  yes  2 

Probably  not  3 

Definitely  not  4 

14.  Do  you  intend  to  switch  to  a  different  health  plan  when  you  next  have  an  opportunity? 

(Circle  one) 

Definitely  yes  1 

Probably  yes  2 

Probably  not  3 

Definitely  not  4 


FURTHER  INFORMATION  ON  SERVICES 
This  next  set  of  questions  asks  about  your  health  care.  The  term  "Provider"  is  a  general  term 
^^^^^^^^^an^efers^jerson^vn^wjwr^imniecdv^iecM^ervkes^^^^^^^^^^ 


15.  How  long  do  you  usually  have  to  wait  between  the  time  you  make  an  appointment  for  care  and 
the  day  you  actually  see  the  provider? 


(Circle  one  number  on  each  line) 


\  B 

SAME 

DAY 

1-3 

DAYS 

4-7 

DAYS 

8-14 

DAYS 

15-30 

DAYS 

31-00 

DAYS 

61+ 

DAYS 

a.  Routine  care  (like  a  check-up) 

1 

2 

3 

4 

5 

6 

7 

b.  Minor  illness  or  injury  (like 
treatment  for  a  sore  throat) 

1 

2 

3 

4 

5 

6 

7 

c.  Chronic  or  ongoing  condition 

1 

2 

3 

4 

5 

6 

7 

d.  Urgent  Care 

1 

2 

3 

4 

5 

6 

7 
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16.  When  calling  for  medical  information  or  advice  how  long  does  it  usually  take  for  your  provider's 
office  to  return  your  call? 


(Circle  one) 


Less  than  1  hour  1 

1  hour  but  less  than  4  hours  2 

4  hours  but  less  than  7  hours  3 

7  hours  but  less  than  24  hours  4 

24  hours  or  more  5 


17.  Once  you  get  to  your  provider's  office  how  long  do  you  usually  have  to  wait  to  see  your  provider 
when  you  have  an  appointment  for  care? 


(Circle  one) 


Less  than  10  minutes  1 

10  to  15  minutes  2 

16  to  30  minutes  3 

More  than  30  minutes  but  less  than  45  minutes  4 

45  minutes  to  1  hour  5 

1  to  2  hours  6 

2  hours  or  more  7 


18.  When  you  go  for  medical  care,  how  often  do  you  see  the  same  provider? 

(Circle  one) 


Always  1 

Most  of  the  time  2 

Sometimes  3 

Rarely  or  never  4 
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HEALTH  AND  DAH^Y  ACTIVITIES 
This  next  series  of  questions  are  to  help  us  gain  a  better  understanding  of  the  health  of  all 
tnembers.  Y our  responses  are  confidential  and  will  only  be  viewed  in  combination  with  all 


Please  answer  every  question.  If  you  are  unsure  about  how  to  answer,  please  give  the  best  answer 
you  can. 


19.  In  general,  would  you  say  your  health  is: 


(Circle  one) 


Excellent  1 

Very  Good  2 

Good  3 

Fair  4 

Poor  5 


The  following  items  are  about  activities  you  might  do  during  a  typical  day.  Does  your  health 
DOW  limit  you  in  these  activities?  If  so,  how  much? 


(Circle  one  number  on  each  line) 


^  ^  4  :4  ^  4k 

YES, 

LIMITED  A 
LOT 

YES, 

LIMITED  A 
LITTLE 

NO,  NOT 
LIMITED  AT 
ALL 

a.  Moderate  activities,  such  as  moving  a  table,  pushing  a 
vacuum  cleaner,  bowling,  or  playing  golf 

1 

2 

3 

b.  Climbing  several  flights  of  stairs 

1 

2 

3 

During  the  pasl  4  weeks,  have  you  had  any  of  the  following  problems  with  your  work  or  other 
regular  daily  activities  as.a  result  of  your  physical  health? 


(Circle  one  number  on  each  line) 


YES 

vaa  «^vaa 

NO 

a.  Accomplished  less  than  you  would  like 

1 

2 

b.  Were  limited  in  the  kind  of  work  or  other  activities 

1 

2 
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22.  During  the  past  4  weeks,  have  you  had  any  of  the  following  problems  with  your  work  or  other 
regular  daily  activities  as  a  result  of  anv  emotional  problems  (such  as  feeling  depressed  or 
anxious)? 


(Circle  one  number  on  each  line) 


t  ■  1 1 1  u  1  ■ . .  1 J  ‘ 

YES 

NO 

a.  Accomplished  less  than  you  would  like 

1 

2 

b.  Didn’t  do  work  or  other  activities  as  carefiilly  as  usual 

1 

2 

23.  During  the  past  4  weeks,  how  much  did  pain  interfere  with  your  normal  work  (including  both 
work  outside  the  home  and  housework)? 


Not  at  all 
A  little  bit 
Moderately 
Quite  a  bit 
Extremely 


(Circle  one) 
1 
2 

3 

4 

5 


24.  These  questions  are  about  how  you  feel  and  how  things  have  been  with  you  during  the  past  4 
weeks.  For  each  question,  please  give  the  one  answer  that  comes  closest  to  the  way  you  have 
been  feeling.  How  much  of  the  time  during  the  past  4  weeks: 


(Circle  one  number  on  each  line) 


i 

\ .  sjisppiji 

ALL 

OF  THE 
TIME 

MOST 
OF  THE 
TIME 

A  GOOD 
BIT  OF 
THE 
TIME 

SOME 
OF  THE 
TIME 

A 

LITTLE 
OF  THE 
TIME 

NONE  OF 
THE 
TIME 

a.  Have  you  felt  calm  and  peaceful 

1 

2 

3 

4 

5 

6 

b.  Did  you  have  a  lot  of  energy 

1 

2 

3 

4 

5 

6 

c.  Have  you  felt  downhearted  and  blue 

1 

2 

3 

4 

5 

6 
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25.  During  the  past  4  weeks,  how  much  of  the  time  has  your  physical  h^lth  or  emotional  problems 
interfered  with  your  social  activities  (like  visiting  with  friends,  relatives,  etc.)? 

(Circle  one) 

All  of  the  time  1 

Most  of  the  time  2 

Some  of  the  time  3 

A  little  of  the  time  4 

None  of  the  time  5 

26.  Compared  to  one  year  ago,  how  would  you  rate  your  health  in  general  now? 

Much  better  now  than  one  year  ago 
Somewhat  better  now  than  one  year  ago 
About  the  same  as  one  year  ago 
Somewhat  worse  now  than  one  year  ago 
Much  worse  now  than  one  year  ago 

27.  Has  a  doctor  F.VF.R  told  you  that  you  had  any  of  the  following  conditions? 


(Circle  one  number  on  each  line) 


YES 

NO 

a.  Hypertension  (sometimes  called  high  blood  pressure) 

1 

2 

b.  Heart  disease  (like  angina  or  heart  failure) 

1 

2 

c.  Diabetes  (high  blood  sugar) 

1 

2 

d.  Cancer  (except  skin  cancer) 

1 

2 

e.  Migraine  (headaches) 

1 

2 

(Circle  one) 
1 
2 

3 

4 

5 
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28.  Do  you  NOW  have  any  of  the  following  conditions? 


(Circle  one  number  on  each  line) 


YES 

NO 

a.  Chronic  allergies  or  sinus  troubles 

1 

2 

b.  Seasonal  allergies,  such  as  hay  fever 

1 

2 

c.  Arthritis  or  any  kind  of  rheumatism 

1 

2 

d.  Sciatica  or  chronic  back  problems 

1 

2 

e.  Trouble  seeing  with  one  or  both  eyes,  even  when  wearing  glasses, 
or  blindness 

1 

2 

f.  Chronic  lung  disease  (like  chronic  bronchitis,  asthma,  or 
emphysema) 

1 

2 

g.  Dermatitis  or  other  chronic  skin  conditions 

1 

2 

h.  Depression 

1 

2 

i.  Ulcers  in  the  stomach  or  duodenum,  or  heartburn 

1 

2 

j.  Deafness  or  other  trouble  hearing  with  one  or  both  ears 

1 

2 

k.  Hemorrhoids 

1 

'  2 

1.  Limitation  in  the  use  of  an  arm  or  leg  (missing,  paralyzed,  or 
weakness) 

1 

2 

29.  Please  provide  the  following  information  about  yourself  (or  about  the  survey  individual,  if  you 


are 

completing  the  survey  for  someone  else). 

1. 

About  how  much  do  you  weigh  without  shoes? 

lbs. 

2. 

About  how  tall  are  you  without  shoes? 

feet  /  inches 

3. 

Do  you  currently: 

(Circle  one  number  on  each  line) 


i  '  S'"''"'' 

YES 

NO 

a.  Exercise  regularly  now?  If  you  answer  "NO”,  go  to  Question  it  29, 
part  4  at  the  TOP  of  the  next  page. 

1 

2 

b.  In  your  own  judgement,  exercise  at  your  own  best  level? 

1 

2 
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4. 


What,  if  anything,  is  keeping  you  from  exercising  at  all,  or  at  your  best  level? 

(Circle  one) 

No  convenient  place  to  exercise  1 

No  safe  place  to  exercise  2 

Not  feeling  up  to  it  3 

Not  enough  energy  ^ 

Pain  5 

Other _ 6 

Not  sure/don't  know  2 


5.  Do  you  currently: 


(Circle  one  number  on  each  line) 


YES 

NO 

a.  Smoke  cigarettes 

1 

2 

b.  Smoke  a  pipe 

1 

2 

c.  Smoke  cigars 

1 

2 

d.  Use  smokeless  tobacco  or  chewing  tobacco 

1 

2 

e.  Use  snuff 

1 

2 

If  you  answered  "NO"  to  ALL  the  answers  in  Question  #29,  part  5,  a-  e,  please  go  to  Question  #30  on 
page  13  of  the  survey. 

6.  On  the  average,  when  you  used  tobacco  products  during  the  last  30  days,  about  how  many  times 
each  day  did  you  use  the  products  (count  each  individual  cigarette,  cigar,  pipe  lighting,  and/or 
dip  into  smokeless  or  chewing  tobacco  or  snuff  as  one  time)? 

(Circle  one  of  the  following) 

Less  than  five  times  1 


Five  to  ten  times  2 

1 1  to  15  times  3 

16  to  20  times  4 

20  to  25  times  5 

26  times  or  more  6 


Not  sure/don't  know 
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ABOUT  YOU 


Please  circle  the  number  next  to  your  answer. 

30.  What  is  your  date  of  birth?  {Write  the  date  on  the  line  below.) 

_ / _ / _ 

MO  DAY  YR 

31.  Are  you  male  or  female? 

1.  Male 

2.  Female 

32.  Are  you  of  Hispanic  or  Spanish  origin? 

1.  Yes 

2.  No 

33.  Which  of  the  following  best  describes  your  racial  or  ethnic  background? 

1 .  Black  or  African-American 

2.  White  or  Caucasian 

3.  Asian  or  Pacific  Islander 

4.  American  Indian/ Alaskan  Native 

5.  Other 

34.  What  is  your  current  marital  status? 

1.  Married 

2.  Divorced 

3.  Separated 

4.  Widowed 

5.  Never  married 


35.  What  is  the  highest  grade  or  level  of  high  school  or  college  that  you  have  completed? 

1 .  8th  Grade  or  less 

2.  Some  High  School 

3.  High  School  Graduate 

4.  Some  College  or  Other  Education  or  Training  After  High  School 

5.  College  Graduate 

6.  Post-Graduate  Education  or  Degree 

36.  Who  completed  this  survey  form? 

1.  Member 

2.  Parent/Other  family  member 

3.  Friend  of  Member 

4.  Other  (specify) _ 

s|>  S|( 

Thank  you  very  much  for  taking  the  time  to  complete  this  survey.  Please  mail  the  survey  back  in  the 
enclosed  stamped  and  addressed  envelope.  Additionally,  don't  forget  to  submit  your  "THE  SETON 
TWO  FREE  MONTHS  OF  HEALTHCARE  PREMIUMS  POSTCARD"  to  ensure  your  eligibility  in  the 
drawing  for  two  FREE  months  of  health  care  premiums  from  the  Seton  Health  Plan.  If  you  have  any 
questions,  please  call  (512)  323-1929  ext.  7987. 
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ATTN:  SHP  Survey  Coordinator 


BUSINESS  REPLY  NAIL 

FIRST-CLASS  MAIL  PERMIT  NO.  4715  AUSTIN  TX 


POSTAGE  WILL  BE  PAID  BY  ADDRESSEE 


NO  POSTAGE 
NECESSARY 
IF  MAILED 
IN  THE 

UNITED  STATES 


SETON  HEALTH  PLAN 

MAIL  STOP  30 

2021  GUADALUPE  ST  STE  100 
AUSTIN  TX  78705-9857 


llllllllllllllllllllllllllllllllllltllllllllllllllll 


’’THK  SKTON  TWO  FRKK  MONTHS  OK  IIKALTIICARK  PRKMIlJMS 

POSTCARD” 

_  YKS  !  Kve  completed  the  survey  and  want  my  name  submitted  for  the 

contest! 

N  A  M  K: _ 

DKPARTMKNT:  _ 

WORK  PHONK:_ _ _ 

HOMK  PMONK: _ 

DRAWINC  TO  HE  HKLD  ON  APRII.  15,  1996 
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ATTN:  SHP  Survqr  Coordinator 
SETON  HEALTH  PLAN 
MAH.  STOP  30 

2021  GUADALUPE  ST  STE  100 
AUSTIN  TX  78705-9857 


THE  SETON  EMPLOYEE  HEALTHCARE  CUSTOMER  SATISFACTION  SURVEY 

Approximately  two  weeks  ago  you  received  a  customer  satisfaction  survey  from  the 
SETON  network  regarding  your  healthcare  benefits  and  services.  If  you  have  not  ha  t  e 
opportunity  to  complete  the  survey,  please  take  the  15  -  20  minutes  required  to  complete  the 
survey.  When  you’re  finished,  please  mail-back  the  survey  in  the  business  reply  Mtura 
envelope  included  with  your  original  survey.  Additionally,  make 
postcard  that  makes  you  eligible  for  the  “THE  SETON  TWO  FREE  MONTHS  OF 
HEALTHCARE  PREMIUMS  POSTCARD”  drawing. 


If  you  haven’t  completed  the  survey,  please  take  the  opportunity  to  do  so  now.  Your 
feedback  on  SETON  healthcare  benefits  and  services  is  important  Thank  you. 
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1201  WEST  38TH  STREET 
AUSTIN,  TEXAS  78705-1056 
(512)  323-1900 


^Salutation*  «First_Naine*  «Last_Name» 
«Street» 

«City»,  «State»  «Zip_Code» 


(512)  459-5629  FAX 


seton@goodhealth.com 


Dear  «Salutation»  4cLast_Name», 


SETON  MEDICAL  CENTER 
(512)  325-1000 


BRACKENRIDGE  HOSPITAL 
(512)  476-6461 


In  our  efforts  to  continuously  address  and  improve  the  health  benefits  and  services 
offered  to  our  employees,  the  Seton  Health  Plan  is  conducting  a  customer 
satisfaction  survey  for  SETON  network  employees.  The  results  from  the  survey 
will  play  an  important  role  in  shaping  future  benefits  and  services. 


SETON  NORTHWEST  HOSPITAL 
(512)  795-1000 


CHILDREN'S  HOSPITAL 
(512)  480-1818 


SETON  EAST  COMMUNITY 
HEALTH  CENTER 
(512)  385-4114 


The  survey  provides  a  comprehensive  list  of  questions  regarding  SETON 
network’s  health  benefits  and  services.  It  takes  approximately  15  -  20  minutes  to 
complete.  Please  read  the  questions  carefully  and  thoughtfully  answer  each 
question.  Once  you’ve  completed  the  survey,  please  place  it  in  the  return 
envelope  and  mail  the  survey. 


SETON  SOUTH  COMMUNITY 
HEALTH  CENTER 
(512)  440-1650 


SETON  SOUTHWEST  MINOR 
EMERGENCY  CENTER 
(512)  326-2243 


SETON  HOME  CARE 
(512)  323-1880 


Your  feedback  is  important  in  shaping  SETON’s  healthcare  benefits  and  services. 
Thank  you  for  your  time  and  survey  submission, 


Sincerely, 


SETON  PHYSICIAN 
HOSPITAL  NETWORK 
(512)  323-1929 


SETON  FUND 
(512)  323-1990 


CHARLES  J.  BARNETT 
President  &  CEO 


CHILDREN'S  HOSPITAL 
FOUNDATION  OF  AUSTIN 
(512)  480-1243 


SETON  HEALTH  PLAN 
(512)  323-1953 


We  serve  each  person  as 
a  Christian  would  serve 
Christ  Himself. 


Daughters  of  Charily 
heal™  services  Of  AUSTIN 


DAUGHTERS 

OF 

CHARITY 
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Note:  Those  variables  without  the  standard  deviation  reported  are  either  binaiy  coded  or  MECE  variables. 


DESCRIPTIVE  STATISTICS  FOR  OTHER 
IMPORTANT  VARIABLES  NOT  USED  IN  THE  ANALYSIS 
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Note:  The  standard  deviations  are  not  reported  as  these  variables  are  MECE  sets. 


